-- Logs begin at Mon 2021-05-24 09:02:54 UTC, end at Mon 2021-05-24 10:25:01 UTC. -- May 24 09:51:39.144951 dv-cinder-791239-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 09:51:39.152493 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 24 09:51:39 2021] *** May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: nodename: dv-cinder-791239-2-iscsi May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: machine: x86_64 May 24 09:51:39.154552 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: clock source: unix May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: pcre jit disabled May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: detected number of CPU cores: 4 May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: current working directory: / May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: detected binary path: /usr/bin/uwsgi-core May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: your processes number limit is 47680 May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: your memory page size is 4096 bytes May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: detected max file descriptor number: 2048 May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: lock engine: pthread robust mutexes May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: thunder lock: enabled May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 09:51:39.154983 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 24 09:51:39.197707 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: Python main interpreter initialized at 0x561f8de299c0 May 24 09:51:39.197707 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: python threads support enabled May 24 09:51:39.197707 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: your server socket listen backlog is limited to 100 connections May 24 09:51:39.197707 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: your mercy for graceful operations on workers is 90 seconds May 24 09:51:39.198101 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: mapped 403077 bytes (393 KB) for 2 cores May 24 09:51:39.198185 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: *** Operational MODE: preforking *** May 24 09:51:39.198433 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: *** uWSGI is running in multiple interpreter mode *** May 24 09:51:39.198433 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: spawned uWSGI master process (pid: 108431) May 24 09:51:39.198630 dv-cinder-791239-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 09:51:39.205075 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: spawned uWSGI worker 1 (pid: 108432, cores: 1) May 24 09:51:39.205075 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: spawned uWSGI worker 2 (pid: 108433, cores: 1) May 24 09:51:39.205075 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 09:51:40.822489 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:51:40.822489 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: from cryptography.utils import int_from_bytes May 24 09:51:40.823244 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:51:40.823244 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: from cryptography.utils import int_from_bytes May 24 09:51:40.825531 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:51:40.825531 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: from cryptography.utils import int_from_bytes May 24 09:51:40.831280 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:51:40.831280 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: from cryptography.utils import int_from_bytes May 24 09:51:43.436444 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:51:43.437014 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:51:43.437179 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:51:43.437532 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:51:43.437906 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:51:43.437906 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:51:43.438055 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:51:43.438133 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.438267 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:51:43.438470 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.438633 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:51:43.438792 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.438878 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:51:43.439120 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.439272 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.439450 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.439606 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.439762 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.439935 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440089 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440264 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440410 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440600 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440739 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.440917 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441016 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441271 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441372 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441601 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441694 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-2-iscsi {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.441937 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442033 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442205 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442302 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442531 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442636 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442844 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.442938 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-2-iscsi {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443149 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443236 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443471 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443558 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443777 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.443864 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.444096 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.444266 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.444407 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.444692 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.444817 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445001 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445153 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445341 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445552 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445762 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445876 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.445969 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446192 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446284 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446510 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446609 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446858 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.446965 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447175 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447268 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447486 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447579 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447822 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.447923 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-2-iscsi {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448125 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448250 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448457 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448587 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448800 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.448893 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449229 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-2-iscsi {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449333 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449557 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449644 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449879 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.449979 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450202 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450302 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450541 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450634 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450851 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.450944 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451179 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451273 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451499 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451594 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451821 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.451915 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452142 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452243 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452447 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452534 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452758 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.452891 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453086 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453190 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453410 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453498 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453717 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.453803 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454027 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454129 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454307 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454393 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454620 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454708 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.454943 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455039 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455254 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455339 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455512 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455605 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455812 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.455900 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456064 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456157 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456384 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456480 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456707 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.456801 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457008 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457136 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457290 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457390 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457616 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457704 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.457933 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458020 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458251 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458349 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458662 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458874 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.458969 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459181 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459268 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459493 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459582 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459806 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.459891 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460117 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460204 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460429 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460521 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460750 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.460834 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461102 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461195 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461408 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461494 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461720 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.461806 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462041 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462128 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462363 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462449 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462673 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462768 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.462991 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463077 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463310 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463397 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463621 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463721 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.463929 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464016 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464274 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464359 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464600 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464695 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.464915 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465009 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465252 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465340 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465544 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465642 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465852 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.465946 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466162 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466256 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466483 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466578 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466736 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.466829 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467050 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467160 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467364 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467468 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467672 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467760 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.467978 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468067 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468287 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468378 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468601 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468691 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.468901 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469009 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469232 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469323 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469542 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469631 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469850 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.469943 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470155 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470244 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470465 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470555 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470769 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.470863 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471081 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471167 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471391 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471478 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471702 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.471864 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472011 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472097 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472318 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472414 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472627 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472726 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.472933 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473026 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473265 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473363 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473574 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473669 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473881 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.473968 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474188 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474281 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474495 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474589 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474801 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.474887 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475111 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475204 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475418 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475511 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475720 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.475805 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476030 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476117 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476340 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476434 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476645 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476738 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.476953 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477040 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477286 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477385 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477589 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477676 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477894 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.477989 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478201 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478299 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478503 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478589 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478804 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.478891 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479105 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479194 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479411 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479495 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479719 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.479809 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.480561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.480656 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.480866 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.480953 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481195 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481284 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481517 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481606 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481830 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.481916 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.482146 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.482243 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.482458 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.482552 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.482805 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:51:43.482900 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483174 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483318 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483506 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483593 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483832 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.483932 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484151 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484251 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484470 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484564 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484798 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.484885 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485135 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485226 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485456 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485543 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485774 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.485862 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486099 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486189 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486417 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486502 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486739 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.486825 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487056 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487143 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487381 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487501 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487707 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.487805 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488041 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488139 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488371 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488460 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488698 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.488784 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489028 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489215 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489376 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489514 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489704 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.489868 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490040 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490213 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490371 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490536 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490693 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.490865 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491043 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491220 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491452 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491542 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491780 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.491877 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492108 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492194 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492424 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492518 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492742 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.492841 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493072 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493163 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493462 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493783 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.493949 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494107 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494194 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494428 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494515 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494740 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.494829 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.495145 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.495240 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.495498 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496112 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496366 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496456 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496683 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496777 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.496998 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497105 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497357 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497499 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497681 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497772 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.497998 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498103 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498309 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498397 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498625 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498712 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.498945 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499046 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499257 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499344 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499577 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499665 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499892 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.499986 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.500968 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501143 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501232 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501337 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501428 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501518 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501598 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501676 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501754 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501831 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.501910 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502037 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502132 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502206 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502378 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502465 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502688 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.502775 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503004 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503096 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503313 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503400 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503637 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503726 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.503950 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504036 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504266 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504353 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504588 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504684 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.504919 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505011 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505252 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505341 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505572 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505659 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505899 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.505984 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506220 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506529 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506623 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506843 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.506929 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507151 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507250 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507459 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507770 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.507870 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508080 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508175 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508384 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508471 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508692 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508779 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.508995 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509126 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509327 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509416 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509635 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509721 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.509948 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510039 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510259 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510352 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510561 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510647 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510868 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.510952 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511223 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511300 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511543 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511637 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511856 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.511944 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512167 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512253 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512477 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512571 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512804 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.512897 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513152 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513253 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513471 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513618 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513779 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.513867 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514087 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514219 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514404 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514503 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514730 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.514824 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515039 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515127 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515350 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515445 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515655 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515741 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.515967 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516053 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516287 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516385 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516608 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516701 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.516918 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517011 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517271 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517362 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517598 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517692 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.517916 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518023 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518227 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518325 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518539 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518626 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518849 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.518945 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519160 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519249 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519475 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519568 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519792 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.519879 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520103 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520197 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520414 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520506 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520722 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.520817 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521041 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521174 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521376 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521474 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521686 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521786 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.521996 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522089 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522310 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522396 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522625 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522720 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.522940 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523026 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523250 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523336 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523572 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523786 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523874 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.523951 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524172 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524259 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524497 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524596 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524811 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.524905 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525140 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525231 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525454 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525544 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525762 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.525849 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526096 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526182 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526409 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526496 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526733 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.526819 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527055 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527142 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527378 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527466 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527691 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.527777 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528012 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528111 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528326 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528425 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528637 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528724 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.528951 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529093 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529290 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529382 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529604 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529692 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.529917 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530013 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530229 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530545 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530640 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.530877 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531013 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531178 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531293 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531488 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531609 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531807 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.531941 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532123 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532258 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532430 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532560 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532745 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.532860 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533072 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533188 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533408 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533649 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533776 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.533985 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.534108 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.534332 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.534452 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.534663 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.534905 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.535033 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.535246 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.535447 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.535560 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.535687 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536311 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536405 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536492 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536572 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536663 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536744 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536822 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.536899 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537144 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537310 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537455 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537545 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537772 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.537861 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538092 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538232 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538399 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538488 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538702 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.538798 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539017 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539113 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539326 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539415 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539633 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539763 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.539943 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540038 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540248 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540379 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540559 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540654 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540867 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.540962 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541200 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541300 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541509 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541595 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541826 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.541922 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.542134 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.542220 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.542980 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543085 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543291 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543387 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543624 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543711 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.543938 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544025 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544250 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544339 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544563 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544658 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544877 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.544965 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545256 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545348 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545571 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545658 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545885 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.545973 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546213 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546308 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546521 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546609 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546831 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.546927 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547139 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547228 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547453 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547542 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547766 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.547875 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548070 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548172 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548383 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548501 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548698 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.548813 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.549273 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.549414 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.549589 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.549684 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.549909 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550006 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550217 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550307 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550531 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550630 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550840 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.550939 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551218 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551335 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551466 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551554 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551782 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.551878 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552091 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552187 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552400 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552495 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552702 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.552788 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553020 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553221 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553351 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553440 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553660 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553746 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.553962 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554058 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554270 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554359 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554584 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554672 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554896 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.554984 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555230 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555326 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555509 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555596 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555850 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.555953 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556131 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556222 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556478 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556584 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556750 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.556838 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557111 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557247 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557388 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557477 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557698 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.557795 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.558059 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.558710 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.558878 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.558976 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559187 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559277 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559499 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559586 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559808 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.559946 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560117 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560203 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560423 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560546 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560730 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.560827 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561072 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561173 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561389 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561477 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561705 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.561801 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562016 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562103 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562367 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562454 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562680 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.562777 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563003 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563092 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563319 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563408 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563637 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563726 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.563947 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564034 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564266 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564353 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564582 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564669 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564895 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.564982 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565226 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565536 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565625 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565858 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.565943 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566173 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566273 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566482 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566575 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566795 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.566882 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567118 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567214 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567438 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567524 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567744 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.567831 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568060 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568157 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568376 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568463 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568688 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568816 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.568998 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569131 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569334 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569444 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569649 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569737 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.569962 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570057 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570273 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570359 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570588 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570675 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570899 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.570987 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571210 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571298 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571522 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571612 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571832 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.571922 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572139 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572230 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572449 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572542 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572765 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.572842 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573091 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573172 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573413 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573532 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573764 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.573841 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574082 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574166 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574385 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574474 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574733 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.574817 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575014 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575126 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575333 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575445 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575643 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.575756 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576072 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576147 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576386 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576471 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576706 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.576789 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577023 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577113 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577368 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577456 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577689 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.577788 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578015 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578092 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578339 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578418 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578657 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578734 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.578986 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579072 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579294 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579383 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579610 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579732 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.579942 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580040 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580251 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580343 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580561 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580649 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580869 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.580960 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581221 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581322 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581533 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581619 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581848 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.581948 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582163 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582257 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582492 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582579 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582807 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.582903 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583142 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583262 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583568 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583663 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583882 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.583983 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584194 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584289 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584521 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584608 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584851 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.584940 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585191 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585283 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585513 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585600 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585830 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.585926 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586158 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586246 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586485 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586573 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586805 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.586892 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587121 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587207 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587429 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587523 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587758 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.587853 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588074 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588167 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588388 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588483 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588698 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.588784 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589029 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589175 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589469 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589575 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589796 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.589883 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590127 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590253 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590459 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590556 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590771 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.590901 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591083 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591216 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591427 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591523 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591751 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.591839 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592066 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592154 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592397 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592485 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592709 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.592795 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593026 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593181 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593367 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593464 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593684 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593797 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.593996 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594103 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594305 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594395 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594621 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594707 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.594939 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595031 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595252 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595341 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595565 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595653 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595897 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.595996 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596211 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596298 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596541 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596629 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596864 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.596959 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597206 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597298 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597521 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597639 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597834 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.597939 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598160 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598264 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598469 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598556 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598775 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.598874 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599086 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599173 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599398 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599487 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599750 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.599845 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600047 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600134 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600377 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600472 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600716 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.600805 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601070 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601161 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601396 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601490 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601739 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.601853 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602059 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602147 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602369 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602457 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602683 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602771 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.602992 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603082 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603304 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603399 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603611 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603696 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.603919 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.604006 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.604225 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.604319 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.604532 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.604627 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.605368 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.605520 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.605703 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.605819 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606010 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606137 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606431 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606632 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606760 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.606934 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607067 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607243 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607376 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607548 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607669 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.607868 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608061 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608213 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608334 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608480 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608605 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608790 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.608907 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609152 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609268 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609466 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609589 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609789 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.609915 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610115 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610251 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610439 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610562 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610762 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.610880 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611078 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611167 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611398 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611538 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611721 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.611816 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612038 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612125 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612360 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612455 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612670 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612758 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.612992 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613110 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613336 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613437 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613657 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613745 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.613970 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.614263 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.614364 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.614596 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.614686 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.614915 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615001 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615231 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615467 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615565 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615804 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.615892 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616126 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616223 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616479 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616580 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616766 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.616855 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617101 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617193 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617422 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617514 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617739 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.617827 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618061 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618149 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618383 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618496 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618705 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.618794 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619033 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619162 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619355 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619443 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619677 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.619765 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.620005 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.620100 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.620334 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.620431 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.621283 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.621383 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.621618 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.621711 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.621947 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622042 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622275 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622363 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622603 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622699 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.622928 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623024 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623252 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623340 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623573 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623663 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623899 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.623987 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624222 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624318 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624537 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624624 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624857 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.624946 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625201 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625310 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625530 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625617 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625856 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.625948 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626181 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626278 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626507 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626602 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626824 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.626919 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627148 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627286 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627496 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627665 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627824 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.627983 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.628171 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.628322 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.628464 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.628651 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.628979 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.629124 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.629327 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.629423 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.629666 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.629752 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630003 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630106 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630312 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630406 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630628 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630755 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.630945 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631047 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631259 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631385 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631570 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631668 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631880 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.631976 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632197 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632292 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632504 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632599 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632814 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.632909 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.633150 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.633251 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.633483 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.633686 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.633783 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634038 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634126 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634359 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634447 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634689 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.634939 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635030 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635301 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635403 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635623 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635725 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.635947 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636034 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636283 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636380 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636592 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636681 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.636912 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637001 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637253 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637373 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637563 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637668 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637872 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.637960 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638189 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638322 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638503 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638600 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638810 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.638904 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639120 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639206 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639427 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639526 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639746 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.639877 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640052 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640146 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640363 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640460 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640672 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640766 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.640984 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641092 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641317 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641407 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641627 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641769 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.641943 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642070 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642243 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642375 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642663 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.642881 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643034 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643191 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643348 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643493 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643630 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643798 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.643947 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644100 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644239 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644397 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644537 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644685 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.644845 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645104 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645277 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645422 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645585 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645796 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.645960 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646102 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646253 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646464 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646619 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646782 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.646951 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.647100 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.647261 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.647410 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.647667 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.647787 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.648031 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.648257 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.648571 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.648870 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.648960 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.649250 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.649495 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.649593 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.649872 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.649962 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.650225 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.650325 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.650545 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.650633 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.650856 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651113 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651226 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651458 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651548 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651806 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.651907 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652118 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652220 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652437 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652534 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652751 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.652841 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.653158 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.653266 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.653407 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.653723 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.653810 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.654037 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.654343 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.654446 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.654729 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.654933 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.655097 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.655367 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.655538 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.655691 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656016 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656137 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656334 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656599 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656687 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.656938 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657028 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657282 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657382 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657607 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657703 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.657936 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658031 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658252 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658339 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658563 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658650 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.658917 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659005 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659255 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659342 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659588 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659691 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.659918 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660005 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660257 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660361 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660649 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660885 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.660973 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.661240 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.661332 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.661569 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.661667 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.661908 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662214 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662292 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662360 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662568 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662662 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662877 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.662974 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663225 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663322 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663568 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663646 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663896 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.663991 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664221 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664318 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664567 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664658 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664888 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.664974 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665228 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665335 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665550 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665638 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665868 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.665965 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666186 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666346 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666512 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666608 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666827 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.666915 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.667149 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.667238 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.667995 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668097 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668325 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668414 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668642 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668732 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.668969 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.669095 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.669362 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.669453 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.669696 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.669795 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670018 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670108 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670340 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670427 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670663 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670758 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.670985 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671074 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671321 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671432 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671639 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671728 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.671973 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672079 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672283 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672386 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672609 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672709 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.672927 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673017 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673295 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673399 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673611 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673702 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.673942 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.674284 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.674519 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.674618 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.674833 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.674922 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675151 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675242 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675467 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675565 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675782 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.675879 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676098 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676188 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676428 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676571 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676758 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.676896 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677093 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677260 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677418 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677595 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677806 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.677926 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678139 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678250 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678464 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678593 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678780 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.678913 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679114 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679236 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679432 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679556 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679754 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.679876 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680070 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680195 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680384 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680516 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680712 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.680853 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681034 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681225 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681384 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681541 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681714 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.681876 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.682045 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.682186 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.682376 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.682521 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.682729 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.683044 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.683159 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.683853 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.684008 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.684200 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.684343 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.684527 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.684625 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:51:43.684857 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.685208 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.685532 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.685943 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.686333 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.686880 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.687233 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.687746 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.688100 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.688465 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.688796 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.689176 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.689518 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:51:43.689772 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:51:43.720134 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_db.sqlalchemy.engines [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:43.724501 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_db.sqlalchemy.engines [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:43.963091 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.context [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0577e5e4-7500-4c18-a8f3-3e205040b20a(cell1) {{(pid=108433) load_cells /opt/stack/nova/nova/context.py:464}} May 24 09:51:43.967850 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:51:43.968950 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.context [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0577e5e4-7500-4c18-a8f3-3e205040b20a(cell1) {{(pid=108432) load_cells /opt/stack/nova/nova/context.py:464}} May 24 09:51:43.969701 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:51:43.970620 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:51:43.972868 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:51:43.973251 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:51:43.974914 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:51:43.975742 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:51:43.977726 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:51:43.997020 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_db.sqlalchemy.engines [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.007210 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_db.sqlalchemy.engines [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.008441 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_db.sqlalchemy.engines [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.010706 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_db.sqlalchemy.engines [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.037230 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG oslo_db.sqlalchemy.engines [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.038505 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_db.sqlalchemy.engines [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:51:44.559142 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: WARNING keystonemiddleware.auth_token [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:51:44.567078 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: WARNING keystonemiddleware.auth_token [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:51:44.606542 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: WARNING keystonemiddleware.auth_token [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:51:44.613270 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: WARNING keystonemiddleware.auth_token [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:51:44.795100 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: WARNING keystonemiddleware.auth_token [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:51:44.800452 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: WARNING keystonemiddleware.auth_token [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:51:44.805682 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f8de299c0 pid: 108433 (default app) May 24 09:51:44.807751 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:51:44.809427 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002192 May 24 09:51:44.809841 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 789 bytes} [Mon May 24 09:51:44 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:51:44.847449 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: WARNING keystonemiddleware.auth_token [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:51:44.852753 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: WARNING keystonemiddleware.auth_token [None req-3d565050-9abb-4c19-93bf-11bb0ece32a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:51:44.858626 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f8de299c0 pid: 108432 (default app) May 24 09:53:09.249005 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:09.250290 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001787 May 24 09:53:09.250969 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:09.894326 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-208a6bdc-b593-4955-ab51-1f24a758a35f admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:09.921085 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-208a6bdc-b593-4955-ab51-1f24a758a35f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.662361 May 24 09:53:09.929269 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Mon May 24 09:53:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:12.092598 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:12.093642 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-3bf3bb11-6346-4d50-9905-3cb0f86a73f3 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 24 09:53:12.094284 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:12.154254 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-bb3065c4-ac3c-4f08-abb4-737ca5d9838e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:12.173380 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:53:12.173380 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: warnings.warn(msg) May 24 09:53:12.295030 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-bb3065c4-ac3c-4f08-abb4-737ca5d9838e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.193470 May 24 09:53:12.295886 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:53:12.657262 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-30445209-7a41-4d19-8296-9ddb7431dc02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:12.659663 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:53:12.659663 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: warnings.warn(msg) May 24 09:53:12.879664 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-30445209-7a41-4d19-8296-9ddb7431dc02 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.571165 May 24 09:53:12.879664 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Mon May 24 09:53:12 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 09:53:15.046344 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-bb3065c4-ac3c-4f08-abb4-737ca5d9838e admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:15.047451 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-bb3065c4-ac3c-4f08-abb4-737ca5d9838e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 24 09:53:15.047859 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:15.171407 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-32da0a31-a4aa-476f-b98f-dc355c18e4ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:15.189777 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:53:15.189777 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: warnings.warn(msg) May 24 09:53:15.303604 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-32da0a31-a4aa-476f-b98f-dc355c18e4ed admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.248952 May 24 09:53:15.304239 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:53:15.318771 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-0755f23b-eb12-4cc7-b809-a6091d477072 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:15.320437 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:53:15.320437 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: warnings.warn(msg) May 24 09:53:15.471499 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-0755f23b-eb12-4cc7-b809-a6091d477072 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.156327 May 24 09:53:15.472269 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Mon May 24 09:53:15 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:17.631486 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-32da0a31-a4aa-476f-b98f-dc355c18e4ed admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:17.632525 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-32da0a31-a4aa-476f-b98f-dc355c18e4ed admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 24 09:53:17.633146 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:17.692742 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-5b3d898b-dba0-4e62-b802-5328b458191c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:17.783982 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-5b3d898b-dba0-4e62-b802-5328b458191c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144282 May 24 09:53:17.784645 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:53:17.796354 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-1e7a8446-3273-454e-92f2-bc4bfe9e091b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:17.901829 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-1e7a8446-3273-454e-92f2-bc4bfe9e091b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109489 May 24 09:53:17.903039 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Mon May 24 09:53:17 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:20.073599 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-5b3d898b-dba0-4e62-b802-5328b458191c admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:20.074666 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-5b3d898b-dba0-4e62-b802-5328b458191c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 24 09:53:20.075078 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:20.134913 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-c251a9dd-b6e4-47a9-affd-8aae19502166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "disk": 10}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:20.269870 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-c251a9dd-b6e4-47a9-affd-8aae19502166 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.188139 May 24 09:53:20.272046 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:53:20.282443 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-656674f6-d723-4f16-ba61-f2ffbaf8397f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:20.403113 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-656674f6-d723-4f16-ba61-f2ffbaf8397f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123968 May 24 09:53:20.403741 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Mon May 24 09:53:20 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 09:53:22.556743 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-c251a9dd-b6e4-47a9-affd-8aae19502166 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:22.557790 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-c251a9dd-b6e4-47a9-affd-8aae19502166 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 24 09:53:22.558191 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:53:22.622893 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:22.750120 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.185122 May 24 09:53:22.751127 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:53:22.763700 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-938d416b-57ca-4c16-9dba-d5e1d121462f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:22.860137 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-938d416b-57ca-4c16-9dba-d5e1d121462f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100724 May 24 09:53:22.861027 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Mon May 24 09:53:22 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:25.045632 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:25.046714 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 May 24 09:53:25.047208 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:25.112671 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-c2f222ba-e14e-49ec-acc9-e239a46d958c admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:25.137196 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-c2f222ba-e14e-49ec-acc9-e239a46d958c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083151 May 24 09:53:25.137765 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Mon May 24 09:53:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:53:27.330860 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:27.331883 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-567fa705-5f02-4f09-9a95-469f4ef02eba admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 24 09:53:27.332532 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:53:27.415752 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-cec6b248-a6af-4086-a408-40d9ec904b80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:27.592116 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-cec6b248-a6af-4086-a408-40d9ec904b80 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.253166 May 24 09:53:27.592721 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:27 2021] POST /compute/v2.1/flavors => generated 402 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:53:27.608302 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-34cf6474-97f0-4425-b11b-0a2f17ba2c38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:27.713740 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-34cf6474-97f0-4425-b11b-0a2f17ba2c38 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110688 May 24 09:53:27.714410 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Mon May 24 09:53:27 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 09:53:29.905887 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-cec6b248-a6af-4086-a408-40d9ec904b80 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:29.907915 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-cec6b248-a6af-4086-a408-40d9ec904b80 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002950 May 24 09:53:29.908757 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:29 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:29.978313 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-47633837-50fb-4a0d-9283-33e414abc530 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:30.067570 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-47633837-50fb-4a0d-9283-33e414abc530 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148495 May 24 09:53:30.068119 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:53:30.094222 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-72505977-10fc-4124-a0a1-c5dc87083db6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:30.237418 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-72505977-10fc-4124-a0a1-c5dc87083db6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150787 May 24 09:53:30.238524 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Mon May 24 09:53:30 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:32.424947 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-47633837-50fb-4a0d-9283-33e414abc530 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:32.426022 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-47633837-50fb-4a0d-9283-33e414abc530 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 24 09:53:32.426591 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:53:32.484501 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-e80703b7-f2e4-49c6-8034-a6b8f27c2a83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "name": "m1.medium"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:32.662727 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-e80703b7-f2e4-49c6-8034-a6b8f27c2a83 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.225511 May 24 09:53:32.662727 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:32 2021] POST /compute/v2.1/flavors => generated 406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:53:32.671400 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-5c2b9a43-eafb-4146-9dbe-05dc393c22a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:32.825183 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-5c2b9a43-eafb-4146-9dbe-05dc393c22a4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158273 May 24 09:53:32.825787 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Mon May 24 09:53:32 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 09:53:34.972770 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-e80703b7-f2e4-49c6-8034-a6b8f27c2a83 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:34.973875 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-e80703b7-f2e4-49c6-8034-a6b8f27c2a83 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 24 09:53:34.974461 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:35.033427 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-e018a3f6-62a0-4da2-bfa5-6b048b50ef73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:35.136961 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-e018a3f6-62a0-4da2-bfa5-6b048b50ef73 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.156235 May 24 09:53:35.137547 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:53:35.149265 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-c218f6a8-0c26-45a9-a84d-39bf9c665fa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:35.243403 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-c218f6a8-0c26-45a9-a84d-39bf9c665fa5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097897 May 24 09:53:35.244117 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Mon May 24 09:53:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 09:53:37.415506 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-e018a3f6-62a0-4da2-bfa5-6b048b50ef73 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:53:37.416562 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-e018a3f6-62a0-4da2-bfa5-6b048b50ef73 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 24 09:53:37.416974 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:53:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:53:37.476284 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:37.619849 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.196090 May 24 09:53:37.620410 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Mon May 24 09:53:37 2021] POST /compute/v2.1/flavors => generated 408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:53:37.632902 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dc33bfd2-a580-403f-855f-7392249d8ee1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:53:37.735949 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dc33bfd2-a580-403f-855f-7392249d8ee1 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106775 May 24 09:53:37.736923 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Mon May 24 09:53:37 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 09:54:16.728206 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:16.729249 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 24 09:54:16.729651 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Mon May 24 09:54:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:16.785608 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-e7a7558a-9af4-4bed-9ed9-4e12098cec48 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:16.809533 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-e7a7558a-9af4-4bed-9ed9-4e12098cec48 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073243 May 24 09:54:16.810002 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Mon May 24 09:54:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:18.185424 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:18.186440 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d2f092e0-9671-4f13-81ed-f8c103c06e7d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 24 09:54:18.186840 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:18.380864 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-9e1a2d94-43c4-40a4-8dbd-cd8c8dbc1d61 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:18.393561 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.wsgi [None req-9e1a2d94-43c4-40a4-8dbd-cd8c8dbc1d61 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 09:54:18.394142 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-9e1a2d94-43c4-40a4-8dbd-cd8c8dbc1d61 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:18.395000 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-9e1a2d94-43c4-40a4-8dbd-cd8c8dbc1d61 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.072332 May 24 09:54:18.395519 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1191 bytes} [Mon May 24 09:54:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:18.405253 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-92a4ac46-3aef-402a-9320-880ee66eaab3 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:18.426894 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-92a4ac46-3aef-402a-9320-880ee66eaab3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025775 May 24 09:54:18.427466 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:18.437331 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-1bf8f68b-d2b5-423e-a364-414a90612ed0 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:18.457226 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-1bf8f68b-d2b5-423e-a364-414a90612ed0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023358 May 24 09:54:18.457765 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:18.467617 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d11e7cb6-9905-431d-a92f-56dec20d15c5 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:18.479876 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.wsgi [None req-d11e7cb6-9905-431d-a92f-56dec20d15c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 09:54:18.481137 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d11e7cb6-9905-431d-a92f-56dec20d15c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:18.481952 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d11e7cb6-9905-431d-a92f-56dec20d15c5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.018476 May 24 09:54:18.482478 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1191 bytes} [Mon May 24 09:54:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:19.804820 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-1bf8f68b-d2b5-423e-a364-414a90612ed0 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:19.805872 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-1bf8f68b-d2b5-423e-a364-414a90612ed0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 24 09:54:19.806269 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:19.993580 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-820e052e-5c9b-473a-adab-f83abf800b63 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:20.006408 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.wsgi [None req-820e052e-5c9b-473a-adab-f83abf800b63 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 09:54:20.006986 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-820e052e-5c9b-473a-adab-f83abf800b63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:20.007786 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-820e052e-5c9b-473a-adab-f83abf800b63 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.065136 May 24 09:54:20.008306 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1191 bytes} [Mon May 24 09:54:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:20.018313 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-b4d00f84-bd1a-4684-8623-559a476074f6 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:20.038189 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-b4d00f84-bd1a-4684-8623-559a476074f6 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023458 May 24 09:54:20.038720 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:20.049219 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-7626c691-dde0-40fc-9910-66a240206ab0 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:20.069405 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-7626c691-dde0-40fc-9910-66a240206ab0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024034 May 24 09:54:20.069946 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 09:54:20.079302 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-a8470c4c-4e3f-4e2c-bf21-12be9068b726 admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:20.091226 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.wsgi [None req-a8470c4c-4e3f-4e2c-bf21-12be9068b726 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 09:54:20.091794 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-a8470c4c-4e3f-4e2c-bf21-12be9068b726 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:20.092573 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-a8470c4c-4e3f-4e2c-bf21-12be9068b726 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.016801 May 24 09:54:20.093097 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1191 bytes} [Mon May 24 09:54:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:21.413241 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-7626c691-dde0-40fc-9910-66a240206ab0 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:21.414275 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-7626c691-dde0-40fc-9910-66a240206ab0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 24 09:54:21.414706 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:21.601498 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-053c21c0-721d-4738-917d-293981a4637d admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:21.615798 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.wsgi [None req-053c21c0-721d-4738-917d-293981a4637d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 09:54:21.616371 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-053c21c0-721d-4738-917d-293981a4637d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:21.617216 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-053c21c0-721d-4738-917d-293981a4637d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.066326 May 24 09:54:21.617745 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1194 bytes} [Mon May 24 09:54:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:21.626959 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-c1477378-1780-40e0-aa90-b23b4fdbae57 admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:21.647472 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-c1477378-1780-40e0-aa90-b23b4fdbae57 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024161 May 24 09:54:21.648017 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:21.658120 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:21.677830 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023171 May 24 09:54:21.678371 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1211 bytes} [Mon May 24 09:54:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:54:21.687493 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-e1bcef72-d8e9-48eb-bc83-ad5e16def79c admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:21.702669 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.wsgi [None req-e1bcef72-d8e9-48eb-bc83-ad5e16def79c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 09:54:21.703241 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-e1bcef72-d8e9-48eb-bc83-ad5e16def79c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 09:54:21.704034 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-e1bcef72-d8e9-48eb-bc83-ad5e16def79c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.020140 May 24 09:54:21.704549 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1194 bytes} [Mon May 24 09:54:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 09:54:23.013079 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:23.014102 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 24 09:54:23.014519 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:54:23.200876 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-f7ea5601-3ea4-4816-9e4c-1af226fc854c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:54:23.337192 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-f7ea5601-3ea4-4816-9e4c-1af226fc854c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.186685 May 24 09:54:23.337741 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1236 bytes} [Mon May 24 09:54:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:54:24.656313 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:24.657477 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 24 09:54:24.657872 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:24.843418 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-50b9b46e-3f46-4e35-a58d-da06a0b9b037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:54:24.941187 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-50b9b46e-3f46-4e35-a58d-da06a0b9b037 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.148567 May 24 09:54:24.941836 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1236 bytes} [Mon May 24 09:54:24 2021] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:54:26.258359 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:26.259353 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 May 24 09:54:26.259740 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:26.450449 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-260be914-8287-4f5d-88ba-9885fb8ed4f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:54:26.541534 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-260be914-8287-4f5d-88ba-9885fb8ed4f3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.142542 May 24 09:54:26.542097 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1236 bytes} [Mon May 24 09:54:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:54:27.864297 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:27.865319 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 24 09:54:27.865715 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:28.053009 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-b3e0f5a6-eae4-4f5d-8281-1b47302fa3bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 09:54:28.150581 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-b3e0f5a6-eae4-4f5d-8281-1b47302fa3bc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.148063 May 24 09:54:28.151051 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1236 bytes} [Mon May 24 09:54:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 09:54:29.475746 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:29.476751 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 24 09:54:29.477254 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:54:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:54:29.671133 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-ba8e532d-66a6-4f3d-a91a-768e5c72efbc admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:54:29.701133 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-ba8e532d-66a6-4f3d-a91a-768e5c72efbc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081845 May 24 09:54:29.701133 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1203 bytes} [Mon May 24 09:54:29 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:55:13.777981 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:55:13.779003 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-dfe00060-8e5a-41a2-9d9e-fdf321271acf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 May 24 09:55:13.779415 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 31/63] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:55:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:55:13.972378 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:55:13.998625 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.078051 May 24 09:55:13.999199 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1203 bytes} [Mon May 24 09:55:13 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:57:13.911458 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-54ca7692-f348-45ac-b005-485fede2d5a8 tempest-verify_tempest_config-449577301 tempest-verify_tempest_config-449577301-project] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:57:13.913580 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-54ca7692-f348-45ac-b005-485fede2d5a8 tempest-verify_tempest_config-449577301 tempest-verify_tempest_config-449577301-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.124314 May 24 09:57:13.914189 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 32/65] 10.222.0.67 () {58 vars in 1134 bytes} [Mon May 24 09:57:13 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 09:58:47.826433 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:58:47.827455 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 24 09:58:47.827905 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 34/66] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:58:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 09:58:48.083093 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:58:48.084316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:58:48.084316 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: warnings.warn(msg) May 24 09:58:48.085930 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:58:48.086378 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:58:48.087672 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:58:48.088113 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:58:48.124288 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-31361881-ea00-4271-aaf5-cef3888f1d8e admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.159207 May 24 09:58:48.124857 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1194 bytes} [Mon May 24 09:58:47 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:58:49.464629 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: DEBUG nova.api.openstack.wsgi [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] Calling method '>' {{(pid=108433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:58:49.465607 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: INFO nova.api.openstack.requestlog [None req-d8e539b5-64a2-43b5-a5f3-269dc40da5cf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 24 09:58:49.466017 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: [pid: 108433|app: 0|req: 35/68] 10.222.0.67 () {56 vars in 1075 bytes} [Mon May 24 09:58:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 09:58:49.669071 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG nova.api.openstack.wsgi [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] Calling method '>' {{(pid=108432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 09:58:49.670592 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:58:49.670592 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: warnings.warn(msg) May 24 09:58:49.672124 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:58:49.672570 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:58:49.673390 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:58:49.673818 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: DEBUG oslo_concurrency.lockutils [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:58:49.704369 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: INFO nova.api.openstack.requestlog [None req-e03db8aa-0ae9-4aa6-b55c-b3725513c41c admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.097327 May 24 09:58:49.704962 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: [pid: 108432|app: 0|req: 34/69] 10.222.0.67 () {60 vars in 1194 bytes} [Mon May 24 09:58:49 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 09:59:43.961478 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: Mon May 24 09:59:43 2021 - graceful shutdown triggered... May 24 09:59:43.961384 dv-cinder-791239-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 09:59:43.962515 dv-cinder-791239-2-iscsi devstack@n-api.service[108432]: Gracefully killing worker 1 (pid: 108432)... May 24 09:59:43.963731 dv-cinder-791239-2-iscsi devstack@n-api.service[108433]: Gracefully killing worker 2 (pid: 108433)... May 24 09:59:44.962484 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: worker 1 buried after 1 seconds May 24 09:59:44.962484 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: worker 2 buried after 1 seconds May 24 09:59:44.962484 dv-cinder-791239-2-iscsi devstack@n-api.service[108431]: goodbye to uWSGI. May 24 09:59:44.964044 dv-cinder-791239-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 09:59:44.964590 dv-cinder-791239-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 09:59:44.967470 dv-cinder-791239-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 09:59:44.978334 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 09:59:44.982296 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 24 09:59:44 2021] *** May 24 09:59:44.982458 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 09:59:44.982596 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 09:59:44.982729 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: nodename: dv-cinder-791239-2-iscsi May 24 09:59:44.982840 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: machine: x86_64 May 24 09:59:44.982950 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: clock source: unix May 24 09:59:44.983057 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: pcre jit disabled May 24 09:59:44.983164 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: detected number of CPU cores: 4 May 24 09:59:44.983271 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: current working directory: / May 24 09:59:44.983384 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: detected binary path: /usr/bin/uwsgi-core May 24 09:59:44.983505 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: your processes number limit is 47680 May 24 09:59:44.983625 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: your memory page size is 4096 bytes May 24 09:59:44.983734 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: detected max file descriptor number: 2048 May 24 09:59:44.983843 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: lock engine: pthread robust mutexes May 24 09:59:44.984139 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: thunder lock: enabled May 24 09:59:44.984654 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 09:59:44.984893 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 24 09:59:45.025567 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: Python main interpreter initialized at 0x561ee79c19c0 May 24 09:59:45.025567 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: python threads support enabled May 24 09:59:45.025567 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: your server socket listen backlog is limited to 100 connections May 24 09:59:45.025567 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: your mercy for graceful operations on workers is 90 seconds May 24 09:59:45.025970 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: mapped 403077 bytes (393 KB) for 2 cores May 24 09:59:45.026045 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: *** Operational MODE: preforking *** May 24 09:59:45.026803 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: *** uWSGI is running in multiple interpreter mode *** May 24 09:59:45.026954 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: spawned uWSGI master process (pid: 123653) May 24 09:59:45.027276 dv-cinder-791239-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 09:59:45.029362 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: spawned uWSGI worker 1 (pid: 123672, cores: 1) May 24 09:59:45.029362 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: spawned uWSGI worker 2 (pid: 123673, cores: 1) May 24 09:59:45.029362 dv-cinder-791239-2-iscsi devstack@n-api.service[123653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 09:59:46.803001 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:59:46.803001 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: from cryptography.utils import int_from_bytes May 24 09:59:46.803690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:59:46.803690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: from cryptography.utils import int_from_bytes May 24 09:59:46.830145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:59:46.830145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: from cryptography.utils import int_from_bytes May 24 09:59:46.830926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:59:46.830926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: from cryptography.utils import int_from_bytes May 24 09:59:49.276599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:59:49.277297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:59:49.277402 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:59:49.277745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:59:49.278018 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:59:49.278421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.278761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.279097 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.279430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.279776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.280101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.280437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.280770 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.281142 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.281421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.281765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.282103 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-2-iscsi {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.282440 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.282767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.283088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.283426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.283741 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.284081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.284400 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.285188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.286512 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.286512 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.286512 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.286928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.287209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.287569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.287871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.288194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.288534 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.288856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.289307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-2-iscsi {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.289640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.290010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.290334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.290754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.291078 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.291402 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.291737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.292612 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.292808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:59:49.293318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.293407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:59:49.293490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.293717 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:59:49.293848 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.294186 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.294268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:59:49.294496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:59:49.294695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.294831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.294933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.295184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.295366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.295539 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.295693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.295854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296483 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296638 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.296940 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297123 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297285 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297470 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297671 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297833 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.297981 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-2-iscsi {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298753 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.298906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.299882 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300179 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.300940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.301277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.301458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.301612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.301765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.301921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.302068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.302236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.302391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.302543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.302694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303190 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303355 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.303964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304269 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304571 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.304869 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-2-iscsi {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305027 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305404 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305702 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.305861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.306892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.307036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.307198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.307351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308225 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308814 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.308972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309308 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309461 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.309951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.310865 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311021 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311324 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311470 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311638 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.311953 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312572 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312718 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.312872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.313199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.313354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.313354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.313672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.313848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314156 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314301 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314769 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.314921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315540 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315696 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315851 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.315996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316147 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316452 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316763 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.316917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317130 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317448 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.317921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318534 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.318976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319651 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319651 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.319935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320233 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320387 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320532 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.320991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321338 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321493 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321656 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321809 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.321963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322119 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322275 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.322873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.323058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.323405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.323566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.323725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.323725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.324025 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.324180 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.324335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.324487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.324634 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.324786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.324943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.325108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.325259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.325415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.325567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.325712 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.325886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.326041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.326194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.326346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.326498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.326650 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.326804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.326958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.327103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.327255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.327411 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.327556 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.327722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.327869 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.328021 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.328176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.328330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.328489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.328640 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.328786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.328937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.329113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.329273 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.329438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.329597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.329761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.329913 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.330058 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.330211 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.330364 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.330511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.330656 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.330819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.330965 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.331110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.331261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.331414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.331597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.331768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.331914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.332067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.332232 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.332390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.332550 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.332703 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.332856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.333010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.333240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.333584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.333748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.333918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.334064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.334209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.334360 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.334519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.334674 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.334829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.334974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.335125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.335278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.335432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.335578 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.335723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.335878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.336038 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.336184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.336337 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.336481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.336625 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.336783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.336946 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.337122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.337281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.337446 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.337599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.337752 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.337915 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.338076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.338230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.338384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.338537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.338714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.338866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.339019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.339165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:59:49.339326 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.339472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.339624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.339779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.339952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340107 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340551 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340757 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.340919 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.341126 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342509 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.342910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.343208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.343208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.343522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.343522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344484 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.344943 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.345873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346181 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.346962 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347114 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347273 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347734 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.347879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348038 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348635 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348780 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.348947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349195 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349502 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349948 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.349948 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350527 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.350986 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351291 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351744 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.351889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352361 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352663 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.352963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.353167 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.353319 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.353478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.353624 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.354021 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.354185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.354877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355026 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355640 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.355943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.356220 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.356364 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.356508 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.356654 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.356808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357222 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357371 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357534 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357718 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357815 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.357991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358164 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358343 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358435 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358703 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.358959 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359078 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.359920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360014 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360898 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.360988 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361250 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361571 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.361994 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362310 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362550 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362649 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.362976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363619 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.363949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364481 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.364895 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365585 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365826 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.365941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366507 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366731 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.366830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367049 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367386 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367710 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.367801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.368770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369023 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369185 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369469 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.369792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.370597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.370701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.370939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371266 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.371915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372015 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.372979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373104 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373242 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373572 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.373986 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374609 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374860 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.374963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.375898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376135 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376285 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.376882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.377132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.377435 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.377531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.377765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.377882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378100 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378749 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.378841 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379070 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379177 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379398 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.379813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.380771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.381775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382760 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.382945 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383271 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383705 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.383926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384368 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384716 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.384935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.385045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.385335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.385443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.385801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.385913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.386950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387044 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387546 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.387947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388534 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388858 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.388964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.389209 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.389308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.389535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.389651 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.389933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390837 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.390938 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391159 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391644 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.391979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.392282 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.392429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.392602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.392750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.392993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.393113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.393400 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.393580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.393754 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.393858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.394057 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.394329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.394432 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.394732 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.394839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395055 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395469 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.395790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396016 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.396976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.397122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.397321 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.397460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.397639 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.397739 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.398985 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399306 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399426 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399600 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.399993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400149 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400556 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.400875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.401892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402198 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402562 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.402881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403103 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.403860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.404844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405499 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405717 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.405819 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406135 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406363 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406455 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.406780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.407975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408076 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.408997 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409128 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409484 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409666 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409762 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.409998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410710 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.410936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411039 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411595 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411693 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.411912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412014 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412710 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.412861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413867 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.413970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414509 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414826 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.414928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.415885 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.416096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.416229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.416412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.416549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.416729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.417601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.417916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.418079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.418444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.418721 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.418840 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.419316 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.419430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.419643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.419738 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.419964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420709 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.420945 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.421139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.421349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.421439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.421669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.421752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422004 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422663 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422755 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.422990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423080 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423326 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.423979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424402 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424636 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.424952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.425044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.425300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.425391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426552 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426821 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426900 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.426981 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427116 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.427941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428241 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428646 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.428904 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.429278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.429610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.429936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.430212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.430573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.430699 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.430914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.431916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.432145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.432254 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433064 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433630 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.433967 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434652 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.434947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435274 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435590 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.435996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436129 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436223 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436482 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436815 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.436905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437201 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437653 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.437984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438649 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.438984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439214 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439314 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439555 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.439982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440312 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440666 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440868 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.440976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441316 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441540 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441869 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.441975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442507 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442824 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.442924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443162 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443484 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443586 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.443917 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444147 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.444919 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.445192 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.445330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.445533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.445659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446727 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.446975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447476 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447815 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.447936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.448252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.448613 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.448770 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.448957 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449167 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449316 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449775 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.449926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.450062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.450417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.450620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.450818 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.451013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.451108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.451378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.451705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452339 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.452971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.453329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.453649 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.453973 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.454309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.454514 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.454679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.454885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.454984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.455254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.455781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.456111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.456416 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.457687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.457888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458224 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458381 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.458879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459196 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.459847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460000 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460574 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.460890 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461118 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.461937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462100 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.462880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463550 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.463892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464324 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464324 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.464924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.465018 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.465159 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.465265 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.465537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.465657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466029 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466379 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466712 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.466807 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467468 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.467802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.468055 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.468173 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.468436 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.468550 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.468776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.469152 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.469297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.469478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.469711 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.469827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470742 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.470847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471156 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471707 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.471809 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472344 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.472996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.473307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.473464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.473670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.473806 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.473988 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.474172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.474526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.474826 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.474947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.475156 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.475397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.475503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.475768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.475876 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476822 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.476939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477209 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477326 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.477980 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.478992 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.479201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.480784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481017 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481388 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481495 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.481821 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482395 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.482969 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.483956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.484049 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.484291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.484387 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.484623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.484831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485552 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.485886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486577 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.486991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.487154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.487310 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.487598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.487928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488742 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.488910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.489234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.489234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.489634 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.489804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.489960 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490126 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.490932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491727 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.491880 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492206 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492682 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.492843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493181 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.493984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494452 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.494987 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495732 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495819 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.495963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.496987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.497139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.497360 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.497462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.497687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.497819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498015 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498146 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.498983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.499091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.499300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.499411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.499626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.499951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.500270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.500611 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.500936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.501152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.506975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.507936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.508647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.509010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.509110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510134 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.510991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511245 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511328 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511513 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511598 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511727 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.511914 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512622 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.512996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513623 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513623 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.513960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514047 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514171 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514402 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514635 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.514954 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515201 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515288 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.515987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516343 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516436 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.516936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517545 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.517983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.518283 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.518467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.518702 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.518817 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519131 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519354 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.519847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520497 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.520826 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521178 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.521885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522437 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522541 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522764 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.522865 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523506 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.523837 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524164 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524749 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.524896 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525107 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.525866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.526090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.526758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.526957 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527583 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.527947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.528918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529296 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529789 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.529967 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530119 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.530975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.531099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.531315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.531446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.531800 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.532147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.532491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.532815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.533176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.533386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.533492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.533769 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.533964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.534664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.534801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.534886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.534974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.534974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.535143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.535257 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.535345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.535530 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.535887 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.541076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.541863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542778 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.542972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543071 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543539 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543731 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.543836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544178 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544446 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544730 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.544817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.545042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547761 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.547942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.548911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.549289 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.549414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.549640 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.549749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.549978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.550145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.550381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.550551 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.550708 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:59:49.550870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.551158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.551505 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.551852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.552191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.552525 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.552879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.553271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.553620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.553950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.554281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.554614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.554977 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.555324 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.555671 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.556050 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.556406 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.556823 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.557172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.557696 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.558218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:59:49.558483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:59:49.590444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_db.sqlalchemy.engines [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:49.598933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_db.sqlalchemy.engines [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:49.939859 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.context [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0577e5e4-7500-4c18-a8f3-3e205040b20a(cell1) {{(pid=123673) load_cells /opt/stack/nova/nova/context.py:464}} May 24 09:59:49.944155 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:59:49.945875 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:59:49.946701 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:59:49.949578 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:59:49.958036 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.context [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0577e5e4-7500-4c18-a8f3-3e205040b20a(cell1) {{(pid=123672) load_cells /opt/stack/nova/nova/context.py:464}} May 24 09:59:49.962602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:59:49.964974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:59:49.965904 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 09:59:49.968134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 09:59:49.978691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_db.sqlalchemy.engines [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:49.979608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_db.sqlalchemy.engines [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:49.998968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_db.sqlalchemy.engines [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:49.999863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_db.sqlalchemy.engines [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:50.012852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_db.sqlalchemy.engines [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:50.032608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_db.sqlalchemy.engines [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:59:50.342569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: WARNING keystonemiddleware.auth_token [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:59:50.350252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: WARNING keystonemiddleware.auth_token [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:59:50.356550 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: WARNING keystonemiddleware.auth_token [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:59:50.363233 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: WARNING keystonemiddleware.auth_token [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:59:50.585352 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: WARNING keystonemiddleware.auth_token [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:59:50.590540 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: WARNING keystonemiddleware.auth_token [None req-f34c99b7-f489-4dcf-94d0-25c3214d989b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:59:50.595546 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: WARNING keystonemiddleware.auth_token [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 09:59:50.595872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ee79c19c0 pid: 123673 (default app) May 24 09:59:50.600670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: WARNING keystonemiddleware.auth_token [None req-66faa2b6-4241-4cfc-8c24-7fef496f88a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 09:59:50.606600 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ee79c19c0 pid: 123672 (default app) May 24 10:00:26.254518 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6d4fd0bc-2212-4900-b673-64c4c836c26d tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Action: 'create', calling method: .version_select at 0x7f0a39dbc820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1321387154", "metadata": {"Type": "work"}}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:26.257013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6d4fd0bc-2212-4900-b673-64c4c836c26d tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:26.258026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6d4fd0bc-2212-4900-b673-64c4c836c26d tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.833001 May 24 10:00:26.261214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1156 bytes} [Mon May 24 10:00:24 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1838 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:00:26.273757 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c886322b-1b11-42a4-bf11-8b2126c922bd tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Action: 'create', calling method: .version_select at 0x7f0a399f5b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1977334830", "metadata": {"Type": "work"}}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:26.275330 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c886322b-1b11-42a4-bf11-8b2126c922bd tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:26.276611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c886322b-1b11-42a4-bf11-8b2126c922bd tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009848 May 24 10:00:26.277309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 2/2] 10.222.0.67 () {60 vars in 1156 bytes} [Mon May 24 10:00:26 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:00:26.286775 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-31ede8c8-d384-4666-a096-7ead01fea263 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Action: 'create', calling method: .version_select at 0x7f0a3a24eca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-223713330", "metadata": {"Type": "work"}}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:26.287977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-31ede8c8-d384-4666-a096-7ead01fea263 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:26.288775 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-31ede8c8-d384-4666-a096-7ead01fea263 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006023 May 24 10:00:26.293366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1156 bytes} [Mon May 24 10:00:26 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 10:00:26.300765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-17620435-9f4e-4288-b54c-4b6bd2bb8620 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Calling method '.version_select at 0x7f0a3999f670>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:27.590888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-17620435-9f4e-4288-b54c-4b6bd2bb8620 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] HTTP exception thrown: Volume tempest-invalid-2015974905 could not be found. May 24 10:00:27.591786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-17620435-9f4e-4288-b54c-4b6bd2bb8620 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 404 to user: Volume tempest-invalid-2015974905 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:27.597719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-17620435-9f4e-4288-b54c-4b6bd2bb8620 tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2015974905" status: 404 len: 99 microversion: 2.1 time: 1.297226 May 24 10:00:27.597719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 4/4] 10.222.0.67 () {58 vars in 1218 bytes} [Mon May 24 10:00:26 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2015974905 => generated 99 bytes in 1298 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 24 10:00:27.605082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a6760926-f725-400e-9d65-781869871c8f tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005067 May 24 10:00:27.611816 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1140 bytes} [Mon May 24 10:00:27 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 10:00:27.631755 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a1aaab90-cae9-410f-a36a-6985254897fd tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010360 May 24 10:00:27.639140 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1137 bytes} [Mon May 24 10:00:27 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 10:00:27.652149 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1297383070", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "1c6bd2e7-cf1c-4cda-aa53-7f057dec1138"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:27.654406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-763b3a8b-8ce5-49db-888c-051808bd4e8f tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Calling method '.version_select at 0x7f0a3999f4c0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:28.008199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-763b3a8b-8ce5-49db-888c-051808bd4e8f tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] HTTP exception thrown: Volume edb0a9ff-10a7-4d79-b9db-cebc0b018e00 could not be found. May 24 10:00:28.009081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-763b3a8b-8ce5-49db-888c-051808bd4e8f tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 404 to user: Volume edb0a9ff-10a7-4d79-b9db-cebc0b018e00 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:28.010170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-763b3a8b-8ce5-49db-888c-051808bd4e8f tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/edb0a9ff-10a7-4d79-b9db-cebc0b018e00" status: 404 len: 109 microversion: 2.1 time: 0.369442 May 24 10:00:28.011233 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 7/7] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:00:27 2021] DELETE /compute/v2.1/os-volumes/edb0a9ff-10a7-4d79-b9db-cebc0b018e00 => generated 109 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:00:28.019553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a22f8771-73e0-4c87-b712-becafd4215cc tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Calling method '.version_select at 0x7f0a39851b80>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:28.199948 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] validate_networks() for [('1c6bd2e7-cf1c-4cda-aa53-7f057dec1138', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:00:28.257472 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-a22f8771-73e0-4c87-b712-becafd4215cc tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] HTTP exception thrown: Volume 1b621eb0-0b1c-46c2-857e-2664adadabde could not be found. May 24 10:00:28.258208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a22f8771-73e0-4c87-b712-becafd4215cc tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] Returning 404 to user: Volume 1b621eb0-0b1c-46c2-857e-2664adadabde could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:00:28.259141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a22f8771-73e0-4c87-b712-becafd4215cc tempest-VolumesNegativeTest-787134501 tempest-VolumesNegativeTest-787134501-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b621eb0-0b1c-46c2-857e-2664adadabde" status: 404 len: 109 microversion: 2.1 time: 0.243091 May 24 10:00:28.260635 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 8/8] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:00:28 2021] GET /compute/v2.1/os-volumes/1b621eb0-0b1c-46c2-857e-2664adadabde => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:00:29.928365 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:00:29.929808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:00:29.930560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:00:29.931250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:00:29.932124 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:00:29.949528 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:29.950921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:29.951911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:29.952702 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:29.986591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Getting quotas for project 35a01011c3994805ba2a956d0daf4aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:29.997234 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Getting quotas for user 04ebaea44c4940e78dc19ddacecf5d4d and project 35a01011c3994805ba2a956d0daf4aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:30.017535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:00:30.025543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:00:30.220806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-67bf23ab-16ef-4e1c-bcf5-35ea33bd5abd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.169712 May 24 10:00:30.226937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 1/9] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:00:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 4174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:00:30.240133 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2255ea96-5053-4364-be97-0c5fd11e6c06 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:30.243516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2255ea96-5053-4364-be97-0c5fd11e6c06 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:30.537381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2255ea96-5053-4364-be97-0c5fd11e6c06 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:30.570188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2255ea96-5053-4364-be97-0c5fd11e6c06 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1215 microversion: 2.1 time: 0.341221 May 24 10:00:30.573332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 9/10] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:30 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1215 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:31.592400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fd28acdb-ffcb-49d9-81cf-893eac28685d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:31.594584 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-fd28acdb-ffcb-49d9-81cf-893eac28685d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:31.769245 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-fd28acdb-ffcb-49d9-81cf-893eac28685d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:31.794099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-fd28acdb-ffcb-49d9-81cf-893eac28685d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1215 microversion: 2.1 time: 0.207886 May 24 10:00:31.806151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 2/11] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:31 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:32.811556 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d11f6e95-d67e-4eb9-a303-2d6da8e06c8b tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:32.812167 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d11f6e95-d67e-4eb9-a303-2d6da8e06c8b tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:32.955963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d11f6e95-d67e-4eb9-a303-2d6da8e06c8b tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:32.965445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d11f6e95-d67e-4eb9-a303-2d6da8e06c8b tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1215 microversion: 2.1 time: 0.158126 May 24 10:00:32.970172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 10/12] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:32 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:33.985816 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:33.986444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:34.006513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:34.007589 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:34.009552 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:34.010045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:34.495315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:34.522090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c9b4cb38-d9b9-4d76-b35f-543e7acc0166 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1211 microversion: 2.1 time: 0.539776 May 24 10:00:34.523217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 3/13] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:33 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1211 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:35.539704 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:35.540351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:35.565516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:35.573403 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:35.583509 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:35.591109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:36.301197 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:36.316776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cb77dfc7-e65e-48ac-a02f-f0675605be25 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1285 microversion: 2.1 time: 0.780754 May 24 10:00:36.324519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 11/14] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:35 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1285 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:37.341686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:37.343256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:37.355912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:37.358458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:37.361741 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:37.362592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:37.994671 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:38.006058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a4c464d8-4d09-441a-86ec-a488a301f692 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1273 microversion: 2.1 time: 0.668760 May 24 10:00:38.020839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 4/15] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:37 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1273 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:39.023193 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:39.023859 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:39.043933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:39.044399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:39.049709 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:39.049709 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:39.280045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:39.305798 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-83a6bd46-c2f4-4501-9325-a5c62ac25189 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1273 microversion: 2.1 time: 0.286313 May 24 10:00:39.309392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 5/16] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:39 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:00:40.325162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:40.325808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:40.343465 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: .version_select at 0x7f0a397909d0>, body: {"keypair": {"name": "tempest-keypair-210612231"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:40.350655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:40.351126 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:40.351938 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:40.352382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:40.518998 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:40.542707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:41.282695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:41.294087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:41.365852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:41.370299 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a535a80d-9f30-45ad-93af-2a05637c0a3b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.448026 May 24 10:00:41.378419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 12/17] 10.222.0.67 () {62 vars in 1199 bytes} [Mon May 24 10:00:38 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2451 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 24 10:00:41.387227 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8010727d-871f-4b3b-96bf-07737bb69195 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 1.057653 May 24 10:00:41.389374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 6/18] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:40 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:42.410286 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:42.410968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:42.429964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:42.443066 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:42.446215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:42.446682 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:42.732838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: .version_select at 0x7f0a39876af0>, body: {"keypair": {"name": "tempest-keypair-427146757"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:42.880104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:42.907957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:43.933544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:43.958415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:44.006691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-07e8c913-22ac-4ff2-8ec2-e0325f12cd2f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.988764 May 24 10:00:44.022488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 13/19] 10.222.0.67 () {60 vars in 1158 bytes} [Mon May 24 10:00:42 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:00:44.529392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:44.547903 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-834e006d-af2f-4cb3-a498-021ac51afd08 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 2.137277 May 24 10:00:44.548952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 7/20] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:42 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:45.566948 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:45.567615 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:45.595008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:45.595421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:45.597917 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:45.598406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:47.287618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-cb471aa4-e416-4efb-bb55-56683bd825ea req-e1a59da9-f797-4a65-a81e-52a6785dc46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af25f39c-cd76-47bd-aace-363ee0770877", "tag": "35e9079c-497b-4448-a787-0fdee4f4fc4c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:47.294475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:00:47.294475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:00:47.308185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-cb471aa4-e416-4efb-bb55-56683bd825ea req-e1a59da9-f797-4a65-a81e-52a6785dc46e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:47.308896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-cb471aa4-e416-4efb-bb55-56683bd825ea req-e1a59da9-f797-4a65-a81e-52a6785dc46e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:47.361182 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-cb471aa4-e416-4efb-bb55-56683bd825ea req-e1a59da9-f797-4a65-a81e-52a6785dc46e service nova] Creating event network-changed:35e9079c-497b-4448-a787-0fdee4f4fc4c for instance af25f39c-cd76-47bd-aace-363ee0770877 on hv-cinder-79123 May 24 10:00:47.364395 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-cb471aa4-e416-4efb-bb55-56683bd825ea req-e1a59da9-f797-4a65-a81e-52a6785dc46e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 24 10:00:47.375777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:47.376260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:47.377154 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:47.386747 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:47.439446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.compute.rpcapi [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 24 10:00:47.446113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=123672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 24 10:00:47.541806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a53c811f-3c0f-42bf-bddd-93856511f0f3 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373924 May 24 10:00:47.543974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 8/21] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:00:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:00:47.814737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:47.835349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8f8115f3-8925-4c94-9fb4-d3890544df0d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 2.273356 May 24 10:00:47.839292 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 14/22] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:45 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:48.861123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:48.861848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:48.895219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:48.896321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:48.901938 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:48.903788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:49.732976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:49.751809 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a325a623-b477-4cbc-8c54-cb0534789d26 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.895886 May 24 10:00:49.752451 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 9/23] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:48 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:49.828323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1168826881", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb75f5-deee-4236-9b04-1b6b5e617606"}], "security_groups": [{"name": "tempest-securitygroup--1492441025"}], "key_name": "tempest-keypair-210612231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:50.768928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:50.769644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:50.781891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:50.782363 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:50.783177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:50.783628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:51.169396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:51.178935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-efe9f992-d3d5-4a9e-a8f7-d03c6d79526e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.413577 May 24 10:00:51.180419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 10/24] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:50 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:00:51.219338 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] validate_networks() for [('c1fb75f5-deee-4236-9b04-1b6b5e617606', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:00:52.198918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:52.199783 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:52.217183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:52.223329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:52.225237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:52.226743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:52.766876 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:52.789987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f766571d-c79c-483d-89a0-68e180b44be5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.595853 May 24 10:00:52.805165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 11/25] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:52 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:53.801939 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1761846439", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e28486c2-462f-406b-8c64-3246ae76f56c"}], "security_groups": [{"name": "tempest-securitygroup--1286635211"}], "key_name": "tempest-keypair-427146757", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:00:53.994363 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:00:53.995390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:00:53.996129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:00:53.996621 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:00:53.997145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:00:54.006459 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:54.007214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:54.008221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:54.008915 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:54.031467 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:54.036419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:54.052829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:00:54.053856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] validate_networks() for [('e28486c2-462f-406b-8c64-3246ae76f56c', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:00:54.057181 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:00:54.258749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ead8085e-8a12-4dcf-a884-0bbccb845a4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.448588 May 24 10:00:54.261472 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 15/26] 10.222.0.67 () {62 vars in 1188 bytes} [Mon May 24 10:00:49 2021] POST /compute/v2.1/servers => generated 402 bytes in 4453 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 24 10:00:54.275372 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:54.280723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:54.297788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:54.298509 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:54.299488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:54.299974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:54.870254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:54.882962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f05f661d-d03d-43fb-be27-c265a4e64296 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.620162 May 24 10:00:54.883564 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 16/27] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:54 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:54.892192 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:54.896582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:54.985494 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:54.995583 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:54.998220 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:55.002346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4a8fcc4f-3cd4-4558-8416-afbfa9dac578 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1281 microversion: 2.20 time: 0.111396 May 24 10:00:55.002346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 17/28] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:00:54 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:00:55.301549 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:00:55.301989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:00:55.302399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:00:55.302815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:00:55.303225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:00:55.319340 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:55.319963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:55.320935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:55.321415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:55.342271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:00:55.347045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:00:55.358476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:00:55.361170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:00:55.478015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a06bf092-773f-438a-85d8-20920f81a8cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.686856 May 24 10:00:55.483513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 12/29] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:00:53 2021] POST /compute/v2.1/servers => generated 402 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:00:55.488656 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1857bb42-1a21-4a0d-aadb-d32236757711 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:55.489318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1857bb42-1a21-4a0d-aadb-d32236757711 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:55.900091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:55.900593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:55.908130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:55.908598 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:55.909417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:55.909873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:55.980906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1857bb42-1a21-4a0d-aadb-d32236757711 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:55.990083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1857bb42-1a21-4a0d-aadb-d32236757711 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1237 microversion: 2.1 time: 0.505131 May 24 10:00:55.992095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 18/30] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:55 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1237 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:56.019439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:56.020254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:56.113545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:56.125276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:56.129110 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:56.130155 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f08bf2ea-f89a-4387-8520-81b4bc27033d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1281 microversion: 2.20 time: 0.116089 May 24 10:00:56.142332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 19/31] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:00:56 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:00:56.314875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:56.327667 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a9bc2e8b-0a40-451e-948b-7c36dc0d96fd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.431450 May 24 10:00:56.328555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 13/32] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:55 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:00:57.009928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:57.010626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:57.024487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.025208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.025820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.026279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.145208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:57.148672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:57.149646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:57.152884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6072c8b9-20c0-4aa9-9b71-2f2d7226a295 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1241 microversion: 2.1 time: 0.147338 May 24 10:00:57.153887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 20/33] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:57 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:57.167046 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.167514 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.168582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.169035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.344707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:57.347531 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:57.371722 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.372189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.373212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:57.373791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:57.381477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:57.396480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:57.400381 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:57.406620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ed4ae609-d0c4-40bb-b3da-e39efcdeb700 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1333 microversion: 2.20 time: 0.257271 May 24 10:00:57.406620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 14/34] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:00:57 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1333 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:00:57.643559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:57.653399 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-770f8e07-968a-4f5f-ab6f-9c219025941c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.312175 May 24 10:00:57.653982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 21/35] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:57 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:00:58.175012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:58.175012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:58.182723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.183404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.184358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.185087 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.330531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:58.341664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5ca2bb84-dbc5-4495-b700-aeff3d50afbb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1297 microversion: 2.1 time: 0.174653 May 24 10:00:58.344511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 15/36] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:58 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1297 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:58.422792 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:58.423589 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:58.435609 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.436115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.437935 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.438414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.624146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:58.636736 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:58.640953 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:58.648672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0e479783-3047-4efb-82c9-e1135ca3df93 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1339 microversion: 2.20 time: 0.230065 May 24 10:00:58.651249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 22/37] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:00:58 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:00:58.670856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:58.672220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:58.686168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.688791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.689971 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:58.690602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:58.960375 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:58.970072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4a065572-d286-4299-9b2a-db2999f7a39d tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.303866 May 24 10:00:58.970606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 16/38] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:58 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:59.363141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:59.364125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:59.380997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.385649 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:59.385649 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.385854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:59.637881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:00:59.649532 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b0facf7c-5f95-42a2-b392-b0ff61c06d7c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1295 microversion: 2.1 time: 0.290298 May 24 10:00:59.650193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 23/39] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:59 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1295 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:00:59.673148 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:59.673781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:59.689990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.694456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:59.694456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.694456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:59.986652 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:00:59.987275 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:00:59.995451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.996289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:00:59.997364 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:00:59.998051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:00.292090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:00.305108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:00.310975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:00.312401 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f09376ba-28af-4a5e-ad7f-e8d0bf23911d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.642990 May 24 10:01:00.314521 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 17/40] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:00:59 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:00.667042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:00.667674 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:00.682778 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:00.683909 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:00.684857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:00.685480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:00.690669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:00.715445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3609795c-07ec-44ca-b6f7-1fbb8ac4911e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.722220 May 24 10:01:00.715445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 24/41] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:00:59 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:01.141480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:01.150620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-69ff9044-5a30-4292-8b81-1f5e94eaf186 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.487315 May 24 10:01:01.152520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 18/42] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:00 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:01.231506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-ab07c044-44ed-493d-abf8-27d5ebed0e18 req-04d841d7-e0fe-4549-88fa-3bd5f171857e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:01.234374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:01.234374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:01:01.263170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-ab07c044-44ed-493d-abf8-27d5ebed0e18 req-04d841d7-e0fe-4549-88fa-3bd5f171857e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.270191 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-ab07c044-44ed-493d-abf8-27d5ebed0e18 req-04d841d7-e0fe-4549-88fa-3bd5f171857e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.297174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-ab07c044-44ed-493d-abf8-27d5ebed0e18 req-04d841d7-e0fe-4549-88fa-3bd5f171857e service nova] Creating event network-changed:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:01:01.298280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-ab07c044-44ed-493d-abf8-27d5ebed0e18 req-04d841d7-e0fe-4549-88fa-3bd5f171857e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 24 10:01:01.299620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.300566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.301715 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.302379 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.314070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.compute.rpcapi [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 24 10:01:01.315560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] Releasing lock "compute-rpcapi-router" {{(pid=123673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 24 10:01:01.334617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:01.335252 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:01.353908 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.354374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.355218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.371193 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.404693 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f9497bfa-2c4f-4696-9370-152cab6f7997 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177620 May 24 10:01:01.406384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 25/43] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:01.629642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-08e35d56-13a8-4d63-9c70-0238a4edc1de req-ad39906d-b64c-45ee-8f14-1af7c373e184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af25f39c-cd76-47bd-aace-363ee0770877", "name": "network-vif-plugged", "status": "completed", "tag": "35e9079c-497b-4448-a787-0fdee4f4fc4c"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:01.632304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:01.632304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:01:01.657334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-08e35d56-13a8-4d63-9c70-0238a4edc1de req-ad39906d-b64c-45ee-8f14-1af7c373e184 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.662480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-08e35d56-13a8-4d63-9c70-0238a4edc1de req-ad39906d-b64c-45ee-8f14-1af7c373e184 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.699012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-08e35d56-13a8-4d63-9c70-0238a4edc1de req-ad39906d-b64c-45ee-8f14-1af7c373e184 service nova] Creating event network-vif-plugged:35e9079c-497b-4448-a787-0fdee4f4fc4c for instance af25f39c-cd76-47bd-aace-363ee0770877 on hv-cinder-79123 May 24 10:01:01.719711 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-08e35d56-13a8-4d63-9c70-0238a4edc1de req-ad39906d-b64c-45ee-8f14-1af7c373e184 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291275 May 24 10:01:01.720527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 26/44] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:01.737634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:01.740346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:01.756344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.757503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:01.762607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:01.763509 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:02.107871 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:02.122519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:02.126279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:02.127693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6e491b90-2a2a-4756-b791-86919bafe98d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.796720 May 24 10:01:02.128543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 19/45] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:01 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:02.171593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:02.171593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:02.183338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:02.185325 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:02.186169 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:02.186612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:02.529701 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:02.544757 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4c4963ee-fc94-43a5-9490-97747b550ad3 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.814404 May 24 10:01:02.549520 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 27/46] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:01 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:02.889623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:02.900890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-52aa4465-f882-4084-b184-5a42ebb7daa3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.736390 May 24 10:01:02.914722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 20/47] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:02 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:02.935881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-6165aac6-5132-417c-aedd-1c95c686bff1 req-54f11b5c-d082-4716-bb24-ea769c9ca93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b44b45-4a2f-48d5-851a-222d48691c7e", "tag": "b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:02.937605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:02.937605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:01:02.952768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-6165aac6-5132-417c-aedd-1c95c686bff1 req-54f11b5c-d082-4716-bb24-ea769c9ca93f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:02.953280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-6165aac6-5132-417c-aedd-1c95c686bff1 req-54f11b5c-d082-4716-bb24-ea769c9ca93f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:02.996668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-6165aac6-5132-417c-aedd-1c95c686bff1 req-54f11b5c-d082-4716-bb24-ea769c9ca93f service nova] Creating event network-changed:b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f for instance b5b44b45-4a2f-48d5-851a-222d48691c7e on hv-cinder-79123 May 24 10:01:03.003914 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-6165aac6-5132-417c-aedd-1c95c686bff1 req-54f11b5c-d082-4716-bb24-ea769c9ca93f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344375 May 24 10:01:03.005957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 28/48] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:03.150468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:03.151713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:03.179455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.179455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:03.180059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.180517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:03.567882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:03.568609 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:03.598036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.598523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:03.599375 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.599834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:03.680686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:03.691288 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:03.692873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:03.694170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6eb57898-1207-471d-8bfb-e5a2db0b4b73 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.549816 May 24 10:01:03.695225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 21/49] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:03 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:03.924026 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:03.924863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:03.933286 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.933821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:03.934758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:03.935264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:04.156076 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:04.181996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-46797f6d-f572-4bfe-8442-1de21422d72e tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.618487 May 24 10:01:04.186582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 29/50] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:03 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:04.381202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:04.390194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-93ea7f35-9e36-4eb1-b622-d76392745ebb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.470375 May 24 10:01:04.390786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 22/51] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:03 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:04.714117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:04.714764 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:04.721957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:04.722415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:04.723194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:04.723638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:04.932996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:04.941794 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:04.945209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:04.945209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b77e5aac-3c0f-4984-a30d-c81580424060 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.234110 May 24 10:01:04.945209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 30/52] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:04 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:05.202561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:05.203189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:05.210567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.211901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:05.211901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.212307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:05.408613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:05.409513 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:05.420906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.421434 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:05.422263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.422721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:05.445390 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:05.449713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c77cca81-e78e-4a1e-a0a2-af6607fa7187 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.250864 May 24 10:01:05.450835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 23/53] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:05 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:05.755596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:05.764331 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9243623a-366a-4a79-874e-29ee0444be94 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.360755 May 24 10:01:05.765251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 31/54] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:05 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:05.963725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:05.964291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:05.974781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.975244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:05.976094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:05.976533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:06.195105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:06.209553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:06.211120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:06.216053 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-22636219-8af6-48c8-93e5-187120a5651c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.254313 May 24 10:01:06.216053 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 24/55] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:05 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:06.474631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:06.474631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:06.480839 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:06.481348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:06.482179 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:06.482633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:06.704560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:06.712952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4c5a9127-495b-46f6-86bf-ead626dd6045 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.249376 May 24 10:01:06.713789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 32/56] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:06 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:06.782177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:06.782961 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:06.791411 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:06.791996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:06.792934 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:06.793879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:07.065901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:07.078139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2fe82a5f-f031-4f97-9940-538048f8f2bf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.299841 May 24 10:01:07.078815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 25/57] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:06 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:07.231713 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:07.232457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:07.248298 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:07.251098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:07.252038 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:07.254070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:07.730926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:07.731594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:07.740450 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:07.740920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:07.746580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:07.747078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:07.882668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:07.898994 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:07.902891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:07.905466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7c8f85e1-f22b-4576-980f-d467833a2c35 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.676972 May 24 10:01:07.906932 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 33/58] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:07 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:08.083538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:08.097805 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:08.098462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:08.108110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-156efa86-1cc1-422a-8dde-e19ac630a3b8 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1315 microversion: 2.1 time: 0.381975 May 24 10:01:08.113989 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:08.116759 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:08.117735 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:08.117878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 26/59] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:07 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:08.118378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:08.379066 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:08.389354 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5d2245a8-dc12-4eac-b2a6-3308d7f02fbf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.297053 May 24 10:01:08.401137 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 34/60] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:08 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:08.924008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:08.926436 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:08.932295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:08.932755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:08.933796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:08.934398 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:09.125546 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:09.126852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:09.141500 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:09.144873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:09.144873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:09.144873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:09.251563 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:09.270121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:09.271965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:09.273323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e64ac18e-b6a5-45bd-b9df-90528dd00823 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.353034 May 24 10:01:09.274472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 27/61] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:08 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:09.410628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:09.412706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:09.426375 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:09.427249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:09.435109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:09.435109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:09.531811 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:09.543417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ef0496b3-5059-42b7-886e-540eb5dff4ed tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1502 microversion: 2.1 time: 0.421201 May 24 10:01:09.544005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 35/62] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:09 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1502 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:09.672400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:09.686511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8a899d91-b4ed-481c-81d2-220691b4b4a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.282683 May 24 10:01:09.687113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 28/63] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:09 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:10.291329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:10.292498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:10.302607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.302607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.302607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.303150 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.531526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:10.541403 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:10.543444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:10.544528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a47b2ebe-6e6d-4be3-9dd4-9ba5ec51d8cb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.257277 May 24 10:01:10.545091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 36/64] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:10 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:10.703444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:10.703989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:10.711331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.711784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.713630 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.713630 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.927332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5fd6513-c88b-4d34-92c5-bb7e21473b99"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:10.929674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:10.954023 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.955487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.966462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:10.966462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:10.972784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:10.988977 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c6bf6067-b775-4c39-b29b-ccc3404f124f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.285495 May 24 10:01:10.990038 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 29/65] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:10 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:11.025884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-af98d3c3-07ae-4d39-bab5-40fd8f87fca6 req-1730d6f9-52a7-4f45-b434-fb2fff3e1e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "name": "network-vif-plugged", "status": "completed", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:11.027531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:11.027531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:11.035957 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-af98d3c3-07ae-4d39-bab5-40fd8f87fca6 req-1730d6f9-52a7-4f45-b434-fb2fff3e1e61 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:11.036413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-af98d3c3-07ae-4d39-bab5-40fd8f87fca6 req-1730d6f9-52a7-4f45-b434-fb2fff3e1e61 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:11.058889 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-af98d3c3-07ae-4d39-bab5-40fd8f87fca6 req-1730d6f9-52a7-4f45-b434-fb2fff3e1e61 service nova] Creating event network-vif-plugged:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:01:11.064876 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-af98d3c3-07ae-4d39-bab5-40fd8f87fca6 req-1730d6f9-52a7-4f45-b434-fb2fff3e1e61 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051012 May 24 10:01:11.065804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 30/66] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:01:11.566527 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:11.567231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:11.581285 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:11.583244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:11.583244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:11.583244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:11.800117 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:11.810068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:11.811593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:11.812795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c9b60e45-48e7-4521-9c07-00b3868fcd46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.250936 May 24 10:01:11.813580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 31/67] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:11 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:12.006348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:12.006951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:12.015070 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:12.015540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:12.016334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:12.016784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:12.244546 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:12.252727 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3b9693ea-f920-4b94-8d5e-8672bc5203bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.250023 May 24 10:01:12.253441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 32/68] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:12 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:12.831583 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:12.832242 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:12.839931 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:12.840388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:12.841202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:12.841744 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:13.051629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:13.060524 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:13.062066 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:13.063149 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cb7cfb27-4208-42fe-a6fc-c901ef9a0d43 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.235372 May 24 10:01:13.063696 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 33/69] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:12 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:13.079539 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-d99625f2-1b41-4447-9d91-27914e1276af req-b985a837-db82-4f53-9167-3316864646ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b44b45-4a2f-48d5-851a-222d48691c7e", "name": "network-vif-plugged", "status": "completed", "tag": "b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:13.081272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:13.081272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:13.090080 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d99625f2-1b41-4447-9d91-27914e1276af req-b985a837-db82-4f53-9167-3316864646ba service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:13.090610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d99625f2-1b41-4447-9d91-27914e1276af req-b985a837-db82-4f53-9167-3316864646ba service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:13.109673 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-d99625f2-1b41-4447-9d91-27914e1276af req-b985a837-db82-4f53-9167-3316864646ba service nova] Creating event network-vif-plugged:b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f for instance b5b44b45-4a2f-48d5-851a-222d48691c7e on hv-cinder-79123 May 24 10:01:13.114599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-d99625f2-1b41-4447-9d91-27914e1276af req-b985a837-db82-4f53-9167-3316864646ba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039323 May 24 10:01:13.115197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 34/70] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:01:13.270950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:13.271492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:13.280514 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:13.281082 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:13.281944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:13.282484 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:13.512469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:13.520735 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0b7987c6-5592-4b1e-9d12-9f3650626552 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.253996 May 24 10:01:13.521344 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 35/71] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:13 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:14.084740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:14.085399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:14.097189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:14.097189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:14.097189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:14.097189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:14.377756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:14.386875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:14.388460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:14.389585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7735e34e-e0b2-4319-9e7b-192140359f45 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1407 microversion: 2.20 time: 0.308618 May 24 10:01:14.390138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 36/72] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:14 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:01:14.542358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:14.545599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:14.551305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:14.551983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:14.553277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:14.553925 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:14.786580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:14.795195 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-df0f09a9-72f9-4620-a536-4b85f5c210ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.261420 May 24 10:01:14.795764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 37/73] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:14 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:14.961521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a5425183-29a6-4564-b36b-66eb7555b401 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "POST /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.030983 May 24 10:01:14.961521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 37/74] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:01:10 2021] POST /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877/os-volume_attachments => generated 194 bytes in 4032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:15.407851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:15.408491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:15.417439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.418294 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.419313 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.419892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.656338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:15.666128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:15.667744 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:15.669292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8aba3bdd-a8ed-4dc3-8571-5ea3dff0a2e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1600 microversion: 2.20 time: 0.265249 May 24 10:01:15.669847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 38/75] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:01:15 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1600 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:01:15.689105 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:15.689387 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:15.700606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.701101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.701916 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.702375 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.812224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:15.812839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:15.820267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.820610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.821441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:15.821878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:15.856942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7f9afc15-00af-4535-8b36-e2588b2891ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.172799 May 24 10:01:15.857589 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 38/76] 10.222.0.67 () {60 vars in 1316 bytes} [Mon May 24 10:01:15 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:16.067304 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:16.080750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-72c89e04-1b25-478f-ae33-bc3fffd1d970 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1363 microversion: 2.1 time: 0.272230 May 24 10:01:16.090366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 39/77] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:15 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:17.097896 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:17.098873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:17.107034 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:17.107643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:17.109338 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:17.109974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:17.698463 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:17.711558 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0ca65eb3-140f-4aee-8ad8-c0973dcdc55f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1548 microversion: 2.1 time: 0.617431 May 24 10:01:17.713660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 39/78] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:17 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1548 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:17.736865 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:17.739713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:17.755332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:17.761273 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:17.762517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:17.763212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:17.950133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-83fe9a3f-9c37-412f-96e0-77f655a1d35a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221452 May 24 10:01:17.950689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 40/79] 10.222.0.67 () {58 vars in 1275 bytes} [Mon May 24 10:01:17 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:18.977451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:18.977451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:18.993118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:18.999878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:18.999878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:18.999878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:19.006962 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-a7733b9a-d093-4707-a414-79ab821804c3 req-cf1ab50b-4b55-4b35-a543-2405f403064f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:19.008500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:19.008500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:19.038925 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a7733b9a-d093-4707-a414-79ab821804c3 req-cf1ab50b-4b55-4b35-a543-2405f403064f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:19.040199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a7733b9a-d093-4707-a414-79ab821804c3 req-cf1ab50b-4b55-4b35-a543-2405f403064f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:19.107809 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-a7733b9a-d093-4707-a414-79ab821804c3 req-cf1ab50b-4b55-4b35-a543-2405f403064f service nova] Creating event network-changed:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:01:19.127371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-a7733b9a-d093-4707-a414-79ab821804c3 req-cf1ab50b-4b55-4b35-a543-2405f403064f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124225 May 24 10:01:19.130236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 41/80] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:19.251523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4e55de87-b283-4e62-b183-630e7cc07c0d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 0.280783 May 24 10:01:19.252163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 40/81] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:18 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:20.270331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:20.272678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:20.286986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:20.288127 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:20.289015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:20.289660 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:21.019818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:21.027224 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:21.045860 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:21.049290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:21.050302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:21.050910 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:22.653339 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bab1aa90-21c6-4a5b-b13b-bf4f114fa4d7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 2.392474 May 24 10:01:22.656615 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 42/82] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:20 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:22.663278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-a0aafcbc-cf31-40a0-b03e-f6bf4a435f23 req-010402dc-6683-45c8-8548-dd413f17a499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b44b45-4a2f-48d5-851a-222d48691c7e", "tag": "b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:22.672145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f4539bf2-b6a5-4e72-b278-568a7071b174 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 14 microversion: 2.1 time: 1.662822 May 24 10:01:22.675504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:22.675504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:22.677141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 41/83] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:21 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 14 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 10:01:22.695610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a0aafcbc-cf31-40a0-b03e-f6bf4a435f23 req-010402dc-6683-45c8-8548-dd413f17a499 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:22.698731 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a0aafcbc-cf31-40a0-b03e-f6bf4a435f23 req-010402dc-6683-45c8-8548-dd413f17a499 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:22.727114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-a0aafcbc-cf31-40a0-b03e-f6bf4a435f23 req-010402dc-6683-45c8-8548-dd413f17a499 service nova] Creating event network-changed:b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f for instance b5b44b45-4a2f-48d5-851a-222d48691c7e on hv-cinder-79123 May 24 10:01:22.734217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-a0aafcbc-cf31-40a0-b03e-f6bf4a435f23 req-010402dc-6683-45c8-8548-dd413f17a499 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078430 May 24 10:01:22.735068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 43/84] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:23.674471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:23.675490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:23.685369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:23.687286 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:23.702193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:23.703474 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:23.705290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:23.706254 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:23.706880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:23.709785 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:23.712223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:23.712941 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:23.875486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-979ac632-337c-41c1-b3a9-e8417beb2946 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 0.214544 May 24 10:01:23.876307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 42/85] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:23 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:23.878094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a4eb13db-d7d7-4a13-88fe-3b072cc7886b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 14 microversion: 2.1 time: 0.197682 May 24 10:01:23.878788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 44/86] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:23 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 10:01:24.886792 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:24.887877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:24.889791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:24.890916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:24.896495 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:24.897176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:24.899294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:24.899294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:24.900288 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:24.901042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:24.901890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:24.902333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:25.004329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-843af43f-a2ce-4d26-a3b6-9feaedb1b4d5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 14 microversion: 2.1 time: 0.119027 May 24 10:01:25.005190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 45/87] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:24 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 10:01:25.008449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3fbee612-e61b-41a9-bb9a-e0a53457e6b8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 0.125398 May 24 10:01:25.009152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 43/88] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:24 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:26.016032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:26.017658 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:26.020797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:26.022213 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:26.028047 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.028703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.029705 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.030419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.033144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.033864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.035309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.035836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.136057 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-98e4a71a-b307-42f6-a278-bface3d5264f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 14 microversion: 2.1 time: 0.124091 May 24 10:01:26.139282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 46/89] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:26 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:01:26.153353 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3170c336-9310-4c80-8c0e-c3819671f7e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 0.137992 May 24 10:01:26.154489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 44/90] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:26 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:26.280936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:26.281781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:26.298246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.298246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.298246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.298246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.360030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:01:26.749669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c205810f-e0c9-4200-b2d2-5837f6d357d4 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 204 len: 0 microversion: 2.1 time: 0.472842 May 24 10:01:26.750264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 47/91] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:01:26 2021] DELETE /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:01:26.758940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:26.760437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:26.769166 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.770081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.771314 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:26.771629 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:26.982383 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:26.991244 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-49879f95-599e-4534-9f64-2683d6e2efbd tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1554 microversion: 2.1 time: 0.236454 May 24 10:01:26.991834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 45/92] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:26 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:27.147581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:27.148590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:27.155827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:27.156518 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:27.157338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:27.157785 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:27.164543 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:27.165530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:27.173685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:27.174281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:27.175148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:27.175736 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:30.284765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-55f65b8a-d8d0-4c6c-83b1-f574597d0201 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 14 microversion: 2.20 time: 3.123624 May 24 10:01:30.285618 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 46/93] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:27 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 14 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:30.290321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-be9f147d-9332-49f0-b8ea-ba77162f8c2a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 14 microversion: 2.1 time: 3.146603 May 24 10:01:30.294214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:30.294330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 48/94] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:27 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 14 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:01:30.294411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:30.300278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:30.300738 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:30.301666 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:30.302122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:30.504618 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:30.513929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1634c14e-140e-43bc-b9d0-93c6d21a2cea tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1554 microversion: 2.1 time: 0.227162 May 24 10:01:30.514530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 47/95] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:30 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:31.296588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:31.297645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:31.303632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:31.304745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:31.306097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:31.307773 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:31.308564 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:31.309197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:31.313120 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:31.313605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:31.314583 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:31.315034 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:33.981716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-362dfbb8-d3d1-4051-9ed5-4c263d650fe6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 13039 microversion: 2.20 time: 2.689822 May 24 10:01:33.982302 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 49/96] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:31 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 13039 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:33.987306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:33.988073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:33.996232 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:33.996708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:33.997537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:33.997986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:34.001818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2af98901-6e73-457d-a5c4-ace1b65921a7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 13917 microversion: 2.1 time: 2.701899 May 24 10:01:34.002463 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 48/97] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:31 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 13917 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:34.195753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:34.204536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bec3630b-d2e6-4f5f-8e89-a4f49c58f16a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1554 microversion: 2.1 time: 0.221065 May 24 10:01:34.205128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 50/98] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:33 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:34.993101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:34.994109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:35.002620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.003171 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.003779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.004222 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.013641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:35.015347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:35.022983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.023458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.024275 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.024729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.111168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4ba5a31f-4049-42f2-9fb6-2651020bfb08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 16450 microversion: 2.20 time: 0.122047 May 24 10:01:35.111832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 49/99] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:34 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 16450 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:35.144138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-93acdccc-1b50-4832-bb98-9f2806eaecac tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 17000 microversion: 2.1 time: 0.134132 May 24 10:01:35.144851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 51/100] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:35 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 17000 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:35.222827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:35.223544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:35.232517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.232982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.233805 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:35.235285 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:35.455916 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:35.465281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-977f0da4-031b-425d-816d-4f4436632a3a tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1554 microversion: 2.1 time: 0.247094 May 24 10:01:35.466415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 50/101] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:35 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:35.580229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-579889521", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "570c27de-a372-4133-bc81-83e9d6aa9b15"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:35.657364 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] validate_networks() for [('570c27de-a372-4133-bc81-83e9d6aa9b15', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:01:36.122412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:36.123457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:36.130978 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.131449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.132551 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.133009 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.252333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-39cc0c2f-f83b-4b68-92bb-13eea2615962 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 18155 microversion: 2.20 time: 0.133977 May 24 10:01:36.253628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 51/102] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:36 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 18155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:01:36.259979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:36.261754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:36.271489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.271994 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.272786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.274053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.383329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3459924c-7974-405d-977b-9f2602973e1a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 18777 microversion: 2.1 time: 0.128345 May 24 10:01:36.384077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 52/103] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:36 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 18777 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:36.401893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-3608e21a-0024-451f-89e2-d9e600cd1775 req-6df6ca6f-1fcf-4a3d-8311-5b34bf666fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af25f39c-cd76-47bd-aace-363ee0770877", "name": "network-vif-deleted", "tag": "35e9079c-497b-4448-a787-0fdee4f4fc4c"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:36.403378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:36.403378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:01:36.412254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3608e21a-0024-451f-89e2-d9e600cd1775 req-6df6ca6f-1fcf-4a3d-8311-5b34bf666fbd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.412705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3608e21a-0024-451f-89e2-d9e600cd1775 req-6df6ca6f-1fcf-4a3d-8311-5b34bf666fbd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.434129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-3608e21a-0024-451f-89e2-d9e600cd1775 req-6df6ca6f-1fcf-4a3d-8311-5b34bf666fbd service nova] Creating event network-vif-deleted:35e9079c-497b-4448-a787-0fdee4f4fc4c for instance af25f39c-cd76-47bd-aace-363ee0770877 on hv-cinder-79123 May 24 10:01:36.440834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-3608e21a-0024-451f-89e2-d9e600cd1775 req-6df6ca6f-1fcf-4a3d-8311-5b34bf666fbd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042493 May 24 10:01:36.442075 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 53/104] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:36.488264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:36.489262 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:36.497789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.498345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.499361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.499810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.552672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:01:36.553161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:01:36.553603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:01:36.554189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:01:36.554775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:01:36.564580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.565253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.566225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:36.567008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:36.595394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Getting quotas for project 6f38795dc42f4d5186770d3b222547ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:01:36.600251 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Getting quotas for user 36ea6bdc02bf40779bab79ba54e04cb1 and project 6f38795dc42f4d5186770d3b222547ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:01:36.611870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:01:36.614687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:01:36.632761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:36.642422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e53ae4bb-8633-462d-8963-f47f1f699164 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1346 microversion: 2.1 time: 0.158365 May 24 10:01:36.642924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 54/105] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:36 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:36.791230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2e27324f-39bf-485f-9479-b756e81203d5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215172 May 24 10:01:36.793187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 52/106] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:01:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:01:36.806981 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-98431955-68ce-405f-aa2f-607e1a8e02e4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:36.808176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-98431955-68ce-405f-aa2f-607e1a8e02e4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:36.889493 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-98431955-68ce-405f-aa2f-607e1a8e02e4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:36.897903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-98431955-68ce-405f-aa2f-607e1a8e02e4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1213 microversion: 2.1 time: 0.098830 May 24 10:01:36.901190 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 55/107] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:36 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:37.264005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:37.265267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:37.274350 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.275136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.276165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.276807 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.396186 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:37.397209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:37.405505 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c5fe8e17-eeed-4525-b23d-d866f48b3b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 19342 microversion: 2.20 time: 0.126213 May 24 10:01:37.406238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 53/108] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:37 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 19342 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:37.412947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.418230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.418230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.418230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.565894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f5239985-82ae-4152-8e73-26c505671279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 20996 microversion: 2.1 time: 0.166894 May 24 10:01:37.566872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 56/109] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:37 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 20996 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:37.661454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:37.666799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:37.672347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.672885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.674009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.674188 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.752967 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.753456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.753943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lazy-loading 'fault' on Instance uuid af25f39c-cd76-47bd-aace-363ee0770877 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:01:37.918639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:37.919344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:37.927611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.928406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.929310 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:37.929963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:37.940738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ebaea44c4940e78dc19ddacecf5d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a01011c3994805ba2a956d0daf4aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:37.955132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4fbfa98f-f8de-4a06-8b9f-40150e0675b5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 200 len: 1351 microversion: 2.1 time: 0.297952 May 24 10:01:37.955316 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 54/110] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:37 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 1351 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:38.066425 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:38.078664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-90c1f535-f3c6-4a44-b6dc-3c5b29dae542 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1217 microversion: 2.1 time: 0.164848 May 24 10:01:38.080045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 57/111] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:37 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:38.418531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:38.419449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:38.426801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:38.427248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:38.428036 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:38.428469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:38.578439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:38.579553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:38.586878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:38.587337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:38.590283 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:38.590283 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:41.378971 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e7535519-3d2f-400c-a8b1-2df3a5e48b33 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 24900 microversion: 2.20 time: 2.964780 May 24 10:01:41.380224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 55/112] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:38 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 24900 bytes in 2967 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:41.385703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:41.386414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:41.394899 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:41.395747 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:41.399747 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-74703aa3-3b0a-4f5d-8052-91db80323197 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 25644 microversion: 2.1 time: 2.824881 May 24 10:01:41.402053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 58/113] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:38 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 25644 bytes in 2829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:41.407360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:41.408537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:41.409250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:41.410198 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:41.432601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:41.433085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:41.433964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:41.434588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:41.493225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] HTTP exception thrown: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. May 24 10:01:41.493942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Returning 404 to user: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:01:41.495009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c0e97359-5da2-4f1b-905c-6419d6e7db7c tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 404 len: 111 microversion: 2.1 time: 0.113287 May 24 10:01:41.495655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 56/114] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:41 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:01:41.596257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:41.607694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b3e796f8-88cb-430d-8d18-d3065395036f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1209 microversion: 2.1 time: 0.204197 May 24 10:01:41.613706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 59/115] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:41 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:42.395101 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:42.396577 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:42.412518 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:42.413487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.413631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:42.415454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.421248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.422494 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.429412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.437683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.438689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.439217 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.570807 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a83d3e63-e9ae-4fb6-80be-1b26d7ff5d29 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 26095 microversion: 2.20 time: 0.181880 May 24 10:01:42.571753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 57/116] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:42 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 26095 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:42.584235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ed032829-f3e4-4c4e-8e5c-c12aeb51605f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 26648 microversion: 2.1 time: 0.175833 May 24 10:01:42.585699 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 60/117] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:42 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 26648 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:42.626151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:42.627567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:42.638251 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.638712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.640779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:42.641429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:42.793279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:42.803073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bd5b10a1-d23f-40db-b5f1-bb3bcbd48a43 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1283 microversion: 2.1 time: 0.181730 May 24 10:01:42.804140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 58/118] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:42 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:43.528961 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:43.530312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:43.541457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.542995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.543930 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.544482 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.583814 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:43.586650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:43.596194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.599250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.599250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.599250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.605816 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] HTTP exception thrown: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. May 24 10:01:43.606518 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Returning 404 to user: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:01:43.607441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-48ea37f2-1dfd-4579-a33d-d905a5570bb5 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 404 len: 111 microversion: 2.1 time: 0.092761 May 24 10:01:43.611416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 61/119] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:01:43 2021] DELETE /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:01:43.616152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:43.617175 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:43.625204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.625766 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.626638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.627159 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.706601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-30994ecb-43af-4f15-92db-94f2bff0c0de tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 27148 microversion: 2.20 time: 0.126610 May 24 10:01:43.708113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 59/120] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:43 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 27148 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:43.712482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:43.713220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] [instance: af25f39c-cd76-47bd-aace-363ee0770877] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:43.727042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.727505 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.728304 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.728749 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.740348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1a9a0a77-baa2-42f1-87ba-17e129c96ccf tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 27523 microversion: 2.1 time: 0.127338 May 24 10:01:43.744333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 62/121] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:43 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 27523 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:43.782740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] HTTP exception thrown: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. May 24 10:01:43.783351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] Returning 404 to user: Instance af25f39c-cd76-47bd-aace-363ee0770877 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:01:43.784229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-66ab4e9e-8742-4527-b3f9-d2d5404d1c46 tempest-DeleteServersTestJSON-1347228157 tempest-DeleteServersTestJSON-1347228157-project] 10.222.0.67 "GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877" status: 404 len: 111 microversion: 2.1 time: 0.075808 May 24 10:01:43.784796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 60/122] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:43 2021] GET /compute/v2.1/servers/af25f39c-cd76-47bd-aace-363ee0770877 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:01:43.824781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:43.828033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:43.847279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.848223 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:43.849261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:43.850321 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.233457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:44.242152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d47a07f6-961b-49c0-ac00-97686d5a7bcb tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.424271 May 24 10:01:44.242740 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 63/123] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:43 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:44.718762 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:44.720261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:44.739703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:44.741611 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.744314 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:44.747791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.753887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:44.755694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:44.779697 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:44.781958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.783046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:44.785870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.919186 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-46e57e81-9b21-489e-a224-12d0877e0df8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 27791 microversion: 2.20 time: 0.204187 May 24 10:01:44.919827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 61/124] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:44 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 27791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:44.924863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-edc20771-0bed-4498-8dc4-cdf185b31995 req-61a6eead-5ee4-4382-9739-ed58b903d973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810ed8e9-80e4-4f0f-8d3c-9f64995bb42b", "tag": "a98f21e3-a592-42a4-b016-d2cf72a32e5c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:44.926468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:44.926468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:44.936117 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-edc20771-0bed-4498-8dc4-cdf185b31995 req-61a6eead-5ee4-4382-9739-ed58b903d973 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:44.936570 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-edc20771-0bed-4498-8dc4-cdf185b31995 req-61a6eead-5ee4-4382-9739-ed58b903d973 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:44.951048 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bccad99f-4e64-4112-a98f-ff1d529a4a75 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 27933 microversion: 2.1 time: 0.202228 May 24 10:01:44.955603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 64/125] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:44 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 27933 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:44.960851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-edc20771-0bed-4498-8dc4-cdf185b31995 req-61a6eead-5ee4-4382-9739-ed58b903d973 service nova] Creating event network-changed:a98f21e3-a592-42a4-b016-d2cf72a32e5c for instance 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b on hv-cinder-79123 May 24 10:01:44.966706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-edc20771-0bed-4498-8dc4-cdf185b31995 req-61a6eead-5ee4-4382-9739-ed58b903d973 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045387 May 24 10:01:44.967576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 62/126] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:01:45.265313 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:45.266440 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:45.277533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.278469 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:45.279876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.280856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:45.823818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:45.836033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3866d9fc-0f94-4bd7-b0f5-7f141efcac93 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.576304 May 24 10:01:45.851516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 65/127] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:45 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:45.931836 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:45.933034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:45.941034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.941520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:45.942356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.942801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:45.962818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:45.964485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:45.972104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.972824 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:45.973790 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:45.974381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:46.057483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dd5bb361-e4b9-4070-bec8-c5d7ff6c8c04 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28178 microversion: 2.20 time: 0.124633 May 24 10:01:46.057483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 63/128] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:45 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28178 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:46.103377 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ed2c6bf4-a4a3-444f-b787-058a3e290a84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28186 microversion: 2.1 time: 0.143655 May 24 10:01:46.104360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 66/129] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:45 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28186 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:46.856262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:46.857299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:46.865256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:46.865719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:46.866511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:46.866978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:47.068364 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:47.069439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:47.085538 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:47.086007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:47.086820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:47.087268 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:47.188230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f9fa96ec-1190-4546-91db-05b0b7e055cc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28220 microversion: 2.20 time: 0.126387 May 24 10:01:47.189457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 67/130] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:47 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:47.200466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:47.201539 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:47.212931 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:47.215229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:47.215843 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:47.216359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:47.330748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-30cc535b-fc2d-4780-9efc-cc7ca42b6380 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28186 microversion: 2.1 time: 0.139381 May 24 10:01:47.331416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 68/131] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:47 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:47.363601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:47.387400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-53643a69-1955-4dc6-beed-42719eeeb8d1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.534704 May 24 10:01:47.396997 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 64/132] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:46 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:48.203567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:48.205268 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:48.214667 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.215125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.216706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.216706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.330446 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6e6bf4d1-6b5f-42f2-8dee-85788c96f70a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28220 microversion: 2.20 time: 0.133672 May 24 10:01:48.332012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 69/133] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:48 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:48.343199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:48.344477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:48.352371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.352898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.353899 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.355013 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.405219 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:48.406142 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:48.414785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.415418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.416295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:48.417495 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:48.465504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b3aec6d7-cd05-449a-818b-4b9c0b7e8b26 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28477 microversion: 2.1 time: 0.126137 May 24 10:01:48.466060 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 65/134] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:48 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28477 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:48.725202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:48.734324 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-93606556-c0c3-472a-a6ad-5e2bdb755668 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.334137 May 24 10:01:48.737524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 70/135] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:48 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:01:49.343525 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:49.344555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:49.358403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.359971 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:49.364082 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.364723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:49.477373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:49.478315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:49.487677 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.488577 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:49.489653 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.491923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:49.526021 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d994dc6e-f005-4159-a8da-f2699849c98b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28511 microversion: 2.20 time: 0.187220 May 24 10:01:49.526694 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 66/136] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:49 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:49.629029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9475182b-ecfa-4d83-bd70-6a6e41379e00 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28477 microversion: 2.1 time: 0.155105 May 24 10:01:49.630374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 71/137] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:49 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:49.752481 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:49.753154 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:49.762861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.763328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:49.764500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:49.764947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:50.126540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:50.140062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cede4028-993a-47f8-b5b7-d929925d74e2 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.391845 May 24 10:01:50.141274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 67/138] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:49 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:50.542372 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:50.543687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:50.555920 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:50.556761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:50.558548 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:50.559422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:50.640978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:50.641930 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:50.649906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:50.650471 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:50.651452 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:50.651904 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:50.664246 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-34555d70-9e92-4d8f-9156-359ffadfd41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28679 microversion: 2.20 time: 0.128870 May 24 10:01:50.664891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 72/139] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:50 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28679 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:50.754301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b8f17724-1aec-45b3-a18f-f7fc4d7677c4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28645 microversion: 2.1 time: 0.116319 May 24 10:01:50.755790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 68/140] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:50 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28645 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:51.161129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:51.162158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:51.173563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.175486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.177013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.177873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.354244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-26c712da-a5ed-46c0-bfc7-b7da776f26c9 req-9ec1f3d5-f75a-431b-ad4c-b18ddb52c2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810ed8e9-80e4-4f0f-8d3c-9f64995bb42b", "name": "network-vif-plugged", "status": "completed", "tag": "a98f21e3-a592-42a4-b016-d2cf72a32e5c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:51.355764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:01:51.355764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:01:51.375781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-26c712da-a5ed-46c0-bfc7-b7da776f26c9 req-9ec1f3d5-f75a-431b-ad4c-b18ddb52c2f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.376244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-26c712da-a5ed-46c0-bfc7-b7da776f26c9 req-9ec1f3d5-f75a-431b-ad4c-b18ddb52c2f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.410691 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-26c712da-a5ed-46c0-bfc7-b7da776f26c9 req-9ec1f3d5-f75a-431b-ad4c-b18ddb52c2f8 service nova] Creating event network-vif-plugged:a98f21e3-a592-42a4-b016-d2cf72a32e5c for instance 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b on hv-cinder-79123 May 24 10:01:51.419221 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-26c712da-a5ed-46c0-bfc7-b7da776f26c9 req-9ec1f3d5-f75a-431b-ad4c-b18ddb52c2f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068844 May 24 10:01:51.419833 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 69/141] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:01:51.610406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:51.620384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2f6c95b0-8e0a-444f-819a-cfeee03322df tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.465333 May 24 10:01:51.620966 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 73/142] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:51 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:51.678605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:51.679640 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:51.692236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.692701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.693534 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.695180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.766536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:51.768706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:51.782493 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.782959 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.783877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:51.784225 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:51.812403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2e9bbe39-fbfd-4fae-ba70-cc0a1908b28d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28679 microversion: 2.20 time: 0.136432 May 24 10:01:51.829308 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 70/143] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:51 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:51.909523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-23181725-df88-4dde-b0f1-4a6ce6e9de70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28645 microversion: 2.1 time: 0.146659 May 24 10:01:51.913879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 74/144] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:51 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28645 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:52.638060 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:52.642204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:52.647460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.648102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:52.649166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.649767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:52.831043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:52.832229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:52.844069 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.844069 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:52.844069 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.844069 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:52.951460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-312996f8-075a-440c-a3cd-08ff1321fd5e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28679 microversion: 2.20 time: 0.125234 May 24 10:01:52.953952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 75/145] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:52 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28679 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:01:52.961294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:52.962695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:52.974420 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.975205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:52.976828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:52.977663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:53.125432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-37e32645-5a6f-4a67-9a11-a764be002144 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 28645 microversion: 2.1 time: 0.169453 May 24 10:01:53.130240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 76/146] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:52 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 28645 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:53.274492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:53.289099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c40081d9-10b8-4975-9121-0ca66bae26d3 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1313 microversion: 2.1 time: 0.655920 May 24 10:01:53.299924 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 71/147] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:52 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:53.967713 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:53.970334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:53.980411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:53.981203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:53.982230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:53.982879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:54.126732 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3ccd982b-5db1-4cdf-bdab-23f73262fb8b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 28679 microversion: 2.20 time: 0.165641 May 24 10:01:54.127986 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 77/148] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:53 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 28679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:54.138168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:54.139618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:54.160796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:54.162151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:54.164242 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:54.165189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:54.307801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:54.308838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:54.333318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:54.333778 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:54.335295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:54.338143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:54.363751 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9f901975-1df6-452e-8f9b-ca754ee61c77 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 29772 microversion: 2.1 time: 0.229297 May 24 10:01:54.367202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 72/149] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:54 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 29772 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:54.860236 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:54.869171 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f13ea5d7-132d-49f0-9590-a23745072f34 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1496 microversion: 2.1 time: 0.565974 May 24 10:01:54.870392 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 78/150] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:54 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1496 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:55.142052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:55.145835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:55.161020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:55.161992 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:55.163434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:55.164034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:55.320732 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-57f1a8e7-eaf6-4101-be27-69b4b46754ed tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 29787 microversion: 2.20 time: 0.184138 May 24 10:01:55.323243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 73/151] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:55 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 29787 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:55.383039 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:55.387865 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:55.397260 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:55.398219 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:55.399459 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:55.400138 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:55.533744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-14f5db7c-0666-442c-af9c-970756c60304 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 31878 microversion: 2.1 time: 0.153424 May 24 10:01:55.538409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 79/152] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:55 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 31878 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:56.334178 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:56.351820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:56.365503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:56.366012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:56.366862 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:56.367349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:56.508311 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a6986dd9-43d8-4252-afd1-e987362448ab tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 32019 microversion: 2.20 time: 0.178575 May 24 10:01:56.509261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 74/153] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:56 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 32019 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:56.547992 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:56.548971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:56.557622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:56.558090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:56.558931 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:56.559555 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:56.683527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-576e13a8-beda-42e2-b26c-d95b211eaa8a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 33056 microversion: 2.1 time: 0.139797 May 24 10:01:56.689633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 80/154] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:56 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 33056 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:57.182819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:57.182819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:57.207637 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.208518 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.209987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.210736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.522077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:57.523089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:57.540812 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:01:57.545256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.545615 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.551333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.552461 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.675125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-405223a3-1208-4553-93bf-572d6bed5b9c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 33368 microversion: 2.20 time: 0.157195 May 24 10:01:57.675763 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 81/155] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:57 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 33368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:01:57.698987 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:57.700044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:57.713414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.717628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.717628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:57.717628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:57.828293 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-165fccc7-4ac0-4c62-b4e1-7e42635fe494 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 33912 microversion: 2.1 time: 0.135396 May 24 10:01:57.828959 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 82/156] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:57 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 33912 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:01:58.034721 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e929a24a-bbc1-4c2c-842b-db3ea90c3e4e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "DELETE /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 204 len: 0 microversion: 2.1 time: 0.859779 May 24 10:01:58.035390 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 75/157] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:01:57 2021] DELETE /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:01:58.055796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:58.056525 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:58.072015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:58.072656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:58.074215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:58.074551 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:58.102446 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-237303161", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0fff367-5ea3-4833-b1bf-44e4dd284af1"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:58.201483 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] validate_networks() for [('b0fff367-5ea3-4833-b1bf-44e4dd284af1', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:01:58.404130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:58.414943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-00ea914d-7b46-4567-b04a-0122bfb8dd17 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1502 microversion: 2.1 time: 0.374471 May 24 10:01:58.417042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 76/158] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:58 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:01:58.696480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:58.698366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:58.710203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:58.710203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:58.710986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:58.711438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:58.814725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-271d782c-a6e1-44e5-9cc7-e0c19ac964fd tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 34036 microversion: 2.20 time: 0.124904 May 24 10:01:58.816604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 77/159] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:01:58 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 34036 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:01:58.833517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1882142823", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:58.937015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] validate_networks() for None {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:01:59.277394 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:01:59.278417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:01:59.279156 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:01:59.279789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:01:59.280418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:01:59.290599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.294896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:01:59.295778 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:01:59.295778 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:01:59.296193 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:01:59.296605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:01:59.300474 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.301312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.301835 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.315293 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.316046 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.316851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.317376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.340225 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Getting quotas for project b08409afad374227ace1cdf31e4e9412. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:01:59.343987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Getting quotas for project efa03a8a310f4bf9ba9e8166f64c9983. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:01:59.344557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Getting quotas for user d6ddb36ff6fe49069f33f103f24f1264 and project b08409afad374227ace1cdf31e4e9412. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:01:59.348895 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Getting quotas for user af7296cf36c94b91bde76813acee1a5e and project efa03a8a310f4bf9ba9e8166f64c9983. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:01:59.360746 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:01:59.361840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:01:59.362706 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:01:59.365553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:01:59.538458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-95a572c0-f201-418e-9a08-a075bb5186b8 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720304 May 24 10:01:59.539743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 78/160] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:01:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:01:59.545742 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:01:59.547099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:59.556019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-290ba0c7-eb79-4843-b8eb-9a672626f70e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.639344 May 24 10:01:59.556019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 83/161] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:01:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:01:59.562030 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:59.562030 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:59.563439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.564135 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.565213 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.565863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.628692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.636537 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.639567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:01:59.640078 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:01:59.742003 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a90cb7ac-45cf-4005-b3ee-cf655a2ad6bb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 35713 microversion: 2.1 time: 0.200727 May 24 10:01:59.747802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 79/162] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:01:59 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 35713 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:01:59.756114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2e9b0f14-9302-42a2-9515-cb2a196b025b tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:01:59.758081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2e9b0f14-9302-42a2-9515-cb2a196b025b tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:01:59.974251 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2e9b0f14-9302-42a2-9515-cb2a196b025b tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:01:59.995323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2e9b0f14-9302-42a2-9515-cb2a196b025b tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1215 microversion: 2.1 time: 0.245928 May 24 10:01:59.998562 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 80/163] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:59 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:00.009130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b5725364-f745-4564-b8a2-a309cd1f9c30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:00.009965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b5725364-f745-4564-b8a2-a309cd1f9c30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:00.257410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b5725364-f745-4564-b8a2-a309cd1f9c30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:00.286851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b5725364-f745-4564-b8a2-a309cd1f9c30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1221 microversion: 2.1 time: 0.283303 May 24 10:02:00.293891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 81/164] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:59 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:00.304485 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:00.309784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:00.331342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:00.331699 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:00.332745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:00.333417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:00.484694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:00.495989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-67112c9a-0b24-441a-a072-a5acd7ea8acb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 35657 microversion: 2.20 time: 0.200449 May 24 10:02:00.496951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 82/165] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:00 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 35657 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:02:00.500720 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6f07d89f-a6c8-41d5-8f76-167a8247968b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1502 microversion: 2.1 time: 0.945761 May 24 10:02:00.515809 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 84/166] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:01:59 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1502 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:00.538726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-179025018", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0fff367-5ea3-4833-b1bf-44e4dd284af1"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:00.674931 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] validate_networks() for [('b0fff367-5ea3-4833-b1bf-44e4dd284af1', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:02:00.756698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:00.758261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:00.774836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:00.775253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:00.780380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:00.781161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:00.984983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-05b4f74a-d0b7-4fa4-9baf-0f73a04ee4ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 37413 microversion: 2.1 time: 0.233666 May 24 10:02:00.986256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 85/167] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:00 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 37413 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:02:01.016146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f272e6eb-94b0-4af8-8932-9f710656bc9e tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:01.016763 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f272e6eb-94b0-4af8-8932-9f710656bc9e tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:01.187899 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f272e6eb-94b0-4af8-8932-9f710656bc9e tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:01.196505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f272e6eb-94b0-4af8-8932-9f710656bc9e tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1215 microversion: 2.1 time: 0.185834 May 24 10:02:01.197433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 86/168] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:01 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:01.361724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-6edb34de-0a5d-4a01-a50b-f955a8d65b97 req-776f0fae-e84b-4c0c-8c22-af0e63d9bdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810ed8e9-80e4-4f0f-8d3c-9f64995bb42b", "name": "network-vif-deleted", "tag": "a98f21e3-a592-42a4-b016-d2cf72a32e5c"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:01.369988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:01.369988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:02:01.381687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-6edb34de-0a5d-4a01-a50b-f955a8d65b97 req-776f0fae-e84b-4c0c-8c22-af0e63d9bdb4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.382386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-6edb34de-0a5d-4a01-a50b-f955a8d65b97 req-776f0fae-e84b-4c0c-8c22-af0e63d9bdb4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.400131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-6edb34de-0a5d-4a01-a50b-f955a8d65b97 req-776f0fae-e84b-4c0c-8c22-af0e63d9bdb4 service nova] Creating event network-vif-deleted:a98f21e3-a592-42a4-b016-d2cf72a32e5c for instance 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b on hv-cinder-79123 May 24 10:02:01.405466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-6edb34de-0a5d-4a01-a50b-f955a8d65b97 req-776f0fae-e84b-4c0c-8c22-af0e63d9bdb4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048002 May 24 10:02:01.406617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 87/169] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:02:01.509995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:01.510892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:01.524802 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.525261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.526597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.527040 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.709449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7dd51d37-3fba-4ccc-ab68-1b376e48587f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 37208 microversion: 2.20 time: 0.202973 May 24 10:02:01.710580 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 88/170] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:01 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 37208 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:02:01.721490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:01.722524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:01.756148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.757079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.758462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.759338 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.958598 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:02:01.959094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:02:01.959504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:02:01.959915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:02:01.960351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:02:01.970076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.970529 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.971344 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:01.971788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:01.993027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Getting quotas for project b08409afad374227ace1cdf31e4e9412. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:02:01.999098 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Getting quotas for user d6ddb36ff6fe49069f33f103f24f1264 and project b08409afad374227ace1cdf31e4e9412. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:02:02.011193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:02.018528 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:02:02.021321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:02:02.034696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-228f7651-9400-4f9d-9183-d0cc5e11c1a5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1298 microversion: 2.1 time: 0.322559 May 24 10:02:02.035601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 89/171] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:01 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1298 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:02.051156 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:02.052304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:02.065366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.065366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.065366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.066040 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.180222 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-96647bb2-531b-4854-9365-1fa1d1f04e90 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 38180 microversion: 2.1 time: 0.133307 May 24 10:02:02.185678 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 90/172] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:02 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 38180 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:02:02.272282 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:02.275092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:02.287889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.288673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.289991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.290758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-82a78efd-99b9-4b1d-98b9-b317f1e9644a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.755197 May 24 10:02:02.291037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.291634 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 83/173] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:02:00 2021] POST /compute/v2.1/servers => generated 383 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:02:02.309722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fe1836e6-8dca-44e2-a97c-65ebb8bdef8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:02.311242 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-fe1836e6-8dca-44e2-a97c-65ebb8bdef8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:02.400024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-fe1836e6-8dca-44e2-a97c-65ebb8bdef8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:02.417171 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-fe1836e6-8dca-44e2-a97c-65ebb8bdef8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1221 microversion: 2.1 time: 0.117858 May 24 10:02:02.418063 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 84/174] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:02 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:02.453637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:02.467373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1dd9ea97-1d7a-4971-832c-a76d2760b25f tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1211 microversion: 2.1 time: 0.252954 May 24 10:02:02.477663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 91/175] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:02 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1211 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:02.723519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:02.724576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:02.734208 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.734680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.735496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:02.736143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:02.867332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d958530b-1563-458c-84e4-07885eb9cde4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 38225 microversion: 2.20 time: 0.147878 May 24 10:02:02.868580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 85/176] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:02 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 38225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:02:03.054976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:03.059473 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:03.080972 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.081363 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.089401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.090170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.198430 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:03.202181 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:03.236860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.237864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.240064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.240522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.270276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.270747 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.271233 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lazy-loading 'fault' on Instance uuid 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:02:03.428813 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-55a14546-892a-482b-bbe0-e357ce3726b1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 38180 microversion: 2.1 time: 0.238778 May 24 10:02:03.436876 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 86/177] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:03 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 38180 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:02:03.445296 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:03.456930 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:03.484189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:03.498487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.503327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.509594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.511286 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.513672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-233f339f-6ab6-467b-a369-136d352acd2f tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 200 len: 1303 microversion: 2.1 time: 0.458761 May 24 10:02:03.524333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 92/178] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:03 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 1303 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:03.543759 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:03.546384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:03.577324 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.578036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.580522 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.581552 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.784829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:03.794318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3c951ef6-7bb4-48aa-8647-6d23653a7c27 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1225 microversion: 2.1 time: 0.355059 May 24 10:02:03.794839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 87/179] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:03 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1225 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:03.892176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:03.893144 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:03.896868 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:03.940820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.949818 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:03.950081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-426b245b-81c9-440a-ad2c-b08411186523 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1267 microversion: 2.1 time: 0.419911 May 24 10:02:03.962505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 93/180] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:03 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1267 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:03.962679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:03.962679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.104819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-84bed50d-08d7-4d20-85ef-6da349f1908b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 38225 microversion: 2.20 time: 0.215916 May 24 10:02:04.105541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 88/181] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:03 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 38225 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:02:04.447078 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:04.448056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:04.477863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.478426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.481905 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.484376 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.532055 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:04.533410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:04.551118 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.551881 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.552818 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.556293 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.618941 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] HTTP exception thrown: Instance 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b could not be found. May 24 10:02:04.619587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Returning 404 to user: Instance 810ed8e9-80e4-4f0f-8d3c-9f64995bb42b could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:02:04.620428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a768bdd4-ffaf-46fb-922d-404bf7193665 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b" status: 404 len: 111 microversion: 2.1 time: 0.092842 May 24 10:02:04.621368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 89/182] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:04 2021] GET /compute/v2.1/servers/810ed8e9-80e4-4f0f-8d3c-9f64995bb42b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:02:04.646637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3a63d131-a2ca-4b07-af8c-1a9586dfac40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 38180 microversion: 2.1 time: 0.205558 May 24 10:02:04.648029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 94/183] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:04 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 38180 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:02:04.777009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2128037934", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "570c27de-a372-4133-bc81-83e9d6aa9b15"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:04.825544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:04.826887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:04.845101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.848441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.849831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:04.850299 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:04.912093 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] validate_networks() for [('570c27de-a372-4133-bc81-83e9d6aa9b15', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:02:05.136951 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:05.154503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-95eb75e7-3763-49f1-be79-32d499b8e8ae tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1273 microversion: 2.1 time: 0.335582 May 24 10:02:05.155714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 95/184] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:04 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:05.161269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:05.162146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:05.173341 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.176398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.176398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.177873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.370509 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:05.385421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d5bce59f-285f-4ecf-bf9f-64b46772cae2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1273 microversion: 2.1 time: 0.228310 May 24 10:02:05.386013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 96/185] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:05 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:05.393096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:05.401717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:05.420487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.425856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.425856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.425856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.628000 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-798cdf78-0cbd-40c1-b334-1b017cf2a548 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 38225 microversion: 2.20 time: 0.240449 May 24 10:02:05.629749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 97/186] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:05 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 38225 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:02:05.664134 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:05.666861 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:05.677794 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.679389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.680843 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.681606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.812251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-20411eb6-5d22-49f4-9a36-037f091fdb10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 200 len: 38311 microversion: 2.1 time: 0.155321 May 24 10:02:05.813765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 98/187] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:05 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 38311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:02:05.825641 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:05.826673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:05.838741 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.839207 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.840000 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:05.840440 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:05.909804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-45ab65fd-a849-46ed-bdc4-ed3957f896e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/ips" status: 200 len: 144 microversion: 2.1 time: 0.089938 May 24 10:02:05.910660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 99/188] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:02:05 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/ips => generated 144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:02:06.177265 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:06.178318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:06.192937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.193906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.195526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.198233 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.526251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:06.539568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a3bf4166-5514-4e58-b51a-65f640b11ba4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1279 microversion: 2.1 time: 0.368288 May 24 10:02:06.540289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 100/189] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:06 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1279 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:06.565251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:06.568628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:06.590633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.593072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.594532 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.595383 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.823331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:02:06.824403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:02:06.825278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:02:06.825793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:02:06.827714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:02:06.855894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.856427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.857459 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.858123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.870952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:06.889467 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a5031560-ce16-4f77-9c43-81486f25c852 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1273 microversion: 2.1 time: 0.334090 May 24 10:02:06.890077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 101/190] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:06 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:06.900157 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Getting quotas for project 6f38795dc42f4d5186770d3b222547ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:02:06.907808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:06.908765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:06.912802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Getting quotas for user 36ea6bdc02bf40779bab79ba54e04cb1 and project 6f38795dc42f4d5186770d3b222547ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:02:06.918986 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.919489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.927187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:06.927187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:06.931259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:02:06.934338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:02:07.028809 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-969eade0-dea7-4843-ac45-fb9c03f59c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 200 len: 38368 microversion: 2.20 time: 0.135813 May 24 10:02:07.029724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 102/191] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:06 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 38368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:02:07.042115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:07.042115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:07.051366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.051939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:07.052810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.053360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:07.125850 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-93009e31-2f31-46e1-8bdf-9b7b6406cd78 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/ips" status: 200 len: 152 microversion: 2.20 time: 0.090008 May 24 10:02:07.142829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 103/192] 10.222.0.67 () {60 vars in 1289 bytes} [Mon May 24 10:02:07 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/ips => generated 152 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:02:07.169729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-735733a6-cfbc-4744-9279-c8f98d8dec7c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.398344 May 24 10:02:07.170693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 90/193] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:02:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:02:07.180738 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0d58bd49-54d8-4047-a5e7-d39b20ae79a6 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:07.181804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0d58bd49-54d8-4047-a5e7-d39b20ae79a6 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:07.370792 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0d58bd49-54d8-4047-a5e7-d39b20ae79a6 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:07.396793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0d58bd49-54d8-4047-a5e7-d39b20ae79a6 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1214 microversion: 2.1 time: 0.218548 May 24 10:02:07.396793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 104/194] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:07 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:07.567354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:07.568717 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:07.607500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.612605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:07.613712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.614378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:07.945876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:07.945876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:07.945876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.945876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:07.946782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:07.946782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:08.180688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:08.203588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-69863cc0-4b95-44fc-b49e-5f4bdfb884e4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1279 microversion: 2.1 time: 0.640558 May 24 10:02:08.205525 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 91/195] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:07 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1279 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:08.271981 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-f64a22be-f7d9-4064-a881-91387cd8e9d8 req-e1db3e86-af7d-4d7f-924e-aaa03f8446c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b161895-21f1-4c71-9f5f-4d521eaea323", "tag": "de553ab6-e238-403d-827d-b143492c1232"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:08.287590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:08.287590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:08.296499 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f64a22be-f7d9-4064-a881-91387cd8e9d8 req-e1db3e86-af7d-4d7f-924e-aaa03f8446c3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:08.296958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f64a22be-f7d9-4064-a881-91387cd8e9d8 req-e1db3e86-af7d-4d7f-924e-aaa03f8446c3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:08.334418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-f64a22be-f7d9-4064-a881-91387cd8e9d8 req-e1db3e86-af7d-4d7f-924e-aaa03f8446c3 service nova] Creating event network-changed:de553ab6-e238-403d-827d-b143492c1232 for instance 5b161895-21f1-4c71-9f5f-4d521eaea323 on hv-cinder-79123 May 24 10:02:08.346319 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-f64a22be-f7d9-4064-a881-91387cd8e9d8 req-e1db3e86-af7d-4d7f-924e-aaa03f8446c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077804 May 24 10:02:08.346922 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 92/196] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:02:08.358969 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:08.374766 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-41998a04-14d7-4b49-93fc-427c8ac1785c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.471115 May 24 10:02:08.375279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 105/197] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:07 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:08.412524 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c4366602-4071-4e8f-b94d-93d874d50805 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:08.413518 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c4366602-4071-4e8f-b94d-93d874d50805 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:08.562166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c4366602-4071-4e8f-b94d-93d874d50805 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:08.583405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c4366602-4071-4e8f-b94d-93d874d50805 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1214 microversion: 2.1 time: 0.173135 May 24 10:02:08.584582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 93/198] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:08 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:09.229132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:09.229132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:09.249621 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:09.250068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:09.254211 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:09.254891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:09.392517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:09.413647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:09.424911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:09.427701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:09.428557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:09.429009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.124728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:10.146529 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-46550c11-9fd1-4e3b-b893-700104837e8f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.922574 May 24 10:02:10.154317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 106/199] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:09 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:10.160005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:10.160797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:10.170711 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.175006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.179407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.180073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.392977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:10.407264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c421c1c3-c6ff-4f37-9d84-b1bd829701e9 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1266 microversion: 2.1 time: 0.250559 May 24 10:02:10.409082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 107/200] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:10 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:10.414809 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf9bba16-8ded-4143-9df7-cf66ebdab579"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:10.415951 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:10.426027 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.427371 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.428949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.430445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.732983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:10.741872 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-818cf9fa-754e-46a8-826e-d53d3be6f2d2 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 1.353420 May 24 10:02:10.742450 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 94/201] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:09 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:10.844574 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:10.846276 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:10.858945 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.859463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.861030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:10.861535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:10.927523 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lazy-loading 'flavor' on Instance uuid 02d59782-db8b-4885-a4ec-a57499c07fe1 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:02:11.927679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b0d7c8fd-22a5-4ac1-b1c8-f6e142ac27e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 202 len: 0 microversion: 2.20 time: 1.089350 May 24 10:02:11.928934 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 95/202] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:10 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:02:11.937978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-35930e75-feb1-45f4-a18d-b4f09e50ad7f req-26e4367d-7bf9-4189-ab1b-207fbe8a0104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e740327b-669e-49e2-9b7c-1f72d272e5e4", "tag": "c7f85b81-de77-4ee2-8223-a1fb751791f5"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:11.939834 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:11.939834 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:11.954720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-35930e75-feb1-45f4-a18d-b4f09e50ad7f req-26e4367d-7bf9-4189-ab1b-207fbe8a0104 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:11.955936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-35930e75-feb1-45f4-a18d-b4f09e50ad7f req-26e4367d-7bf9-4189-ab1b-207fbe8a0104 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:11.982032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-35930e75-feb1-45f4-a18d-b4f09e50ad7f req-26e4367d-7bf9-4189-ab1b-207fbe8a0104 service nova] Creating event network-changed:c7f85b81-de77-4ee2-8223-a1fb751791f5 for instance e740327b-669e-49e2-9b7c-1f72d272e5e4 on hv-cinder-79123 May 24 10:02:11.987605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-35930e75-feb1-45f4-a18d-b4f09e50ad7f req-26e4367d-7bf9-4189-ab1b-207fbe8a0104 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055818 May 24 10:02:11.988767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 96/203] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:11.993967 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:11.994863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:12.002740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.003501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.004487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.005158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.100271 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b5fd79a2-530d-4db4-a396-922179c10692 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.688379 May 24 10:02:12.112816 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 108/204] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:02:10 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-volume_attachments => generated 194 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:12.118638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:12.119561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:12.128318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.128809 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.130410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.130410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.563955 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:12.590526 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-79d24ccd-1057-4695-afc8-ba2f91413405 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.600351 May 24 10:02:12.595496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 97/205] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:11 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:12.596620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:12.597455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:12.623896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.624366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.625207 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.625662 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.834897 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:12.854469 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-707aab69-b636-4b0e-b5ed-36946a82da51 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.738074 May 24 10:02:12.855364 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 109/206] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:12 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:12.863079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:12.864855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:12.874732 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.875406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:12.876438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:12.877037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:13.068704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:13.085331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-07c9b5a9-a3ec-4791-a95e-37eb19036e2a tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.492588 May 24 10:02:13.085924 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 98/207] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:12 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:13.302963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:13.323663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:13.325895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:13.326478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a9a968fe-fb25-4652-90c5-e2a647d5bd87 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.469952 May 24 10:02:13.337791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 110/208] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:12 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:13.615855 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:13.617874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:13.645404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:13.645893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:13.646651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:13.647367 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:13.872021 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:13.873093 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:13.883502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:13.883884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:13.887692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:13.888141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.147105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.156501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-41c96f08-27c1-4612-9aab-584c08435d30 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.548611 May 24 10:02:14.167318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 99/209] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:13 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:14.172664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:14.173296 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:14.183030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.183486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.184282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.184760 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.314066 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.324962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4f00eba5-7be4-4f29-b9b5-fe49e06ff8f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.456595 May 24 10:02:14.334702 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 111/210] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:13 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:14.340729 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-e3fc421f-7151-4734-9a63-3bc969f675bb req-b40805fb-44ab-4ed8-b04d-b455eeaac8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ea541a-eca6-424a-be23-a7324dd192c7", "tag": "c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:14.342530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:14.342530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:02:14.352933 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e3fc421f-7151-4734-9a63-3bc969f675bb req-b40805fb-44ab-4ed8-b04d-b455eeaac8b6 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.353438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e3fc421f-7151-4734-9a63-3bc969f675bb req-b40805fb-44ab-4ed8-b04d-b455eeaac8b6 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.373574 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-e3fc421f-7151-4734-9a63-3bc969f675bb req-b40805fb-44ab-4ed8-b04d-b455eeaac8b6 service nova] Creating event network-changed:c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde for instance c8ea541a-eca6-424a-be23-a7324dd192c7 on hv-cinder-79123 May 24 10:02:14.379640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-e3fc421f-7151-4734-9a63-3bc969f675bb req-b40805fb-44ab-4ed8-b04d-b455eeaac8b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042883 May 24 10:02:14.381485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 112/211] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:14.387690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-a3f3588b-a9cf-4306-9539-95d2d341fd46 req-62c176e8-9abe-4fb9-9e07-6d7db788fc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b09368d-88d6-4178-8690-92edbf156805", "tag": "5479c5f8-df8c-4e32-9a54-3dff2b992272"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:14.389549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:14.389549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:02:14.407867 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-a3f3588b-a9cf-4306-9539-95d2d341fd46 req-62c176e8-9abe-4fb9-9e07-6d7db788fc32 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.408327 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-a3f3588b-a9cf-4306-9539-95d2d341fd46 req-62c176e8-9abe-4fb9-9e07-6d7db788fc32 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.426145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-a3f3588b-a9cf-4306-9539-95d2d341fd46 req-62c176e8-9abe-4fb9-9e07-6d7db788fc32 service nova] Creating event network-changed:5479c5f8-df8c-4e32-9a54-3dff2b992272 for instance 5b09368d-88d6-4178-8690-92edbf156805 on hv-cinder-79123 May 24 10:02:14.431527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-a3f3588b-a9cf-4306-9539-95d2d341fd46 req-62c176e8-9abe-4fb9-9e07-6d7db788fc32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048430 May 24 10:02:14.432448 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 113/212] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:14.438256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:14.438975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:14.447485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.447948 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.449126 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:14.449729 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:14.518379 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.529422 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3e0dbf61-8188-45fc-82d3-e6a24ed47b87 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.360064 May 24 10:02:14.540644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 100/213] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:14 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:14.893853 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.905617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.907184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:14.908339 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0ef82e21-af24-4bf4-815c-f236cb4692c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.474764 May 24 10:02:14.908887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 114/214] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:14 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:15.175828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:15.176440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:15.189213 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.189670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.191673 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.192128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.341715 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:15.342971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:15.368927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.370008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.370802 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.381003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.556661 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:15.565503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6dbeaa61-c3d7-4015-aecb-75ea9e99b467 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.394825 May 24 10:02:15.566526 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 101/215] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:15 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:15.571466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-d8ac20e3-6932-4c43-b8f9-9754fc4dfb63 req-a8904f77-ceaa-4ae7-8c6a-59a3dc3d4f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b161895-21f1-4c71-9f5f-4d521eaea323", "name": "network-vif-plugged", "status": "completed", "tag": "de553ab6-e238-403d-827d-b143492c1232"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:15.573624 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:15.573624 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:15.588864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d8ac20e3-6932-4c43-b8f9-9754fc4dfb63 req-a8904f77-ceaa-4ae7-8c6a-59a3dc3d4f07 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.589349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d8ac20e3-6932-4c43-b8f9-9754fc4dfb63 req-a8904f77-ceaa-4ae7-8c6a-59a3dc3d4f07 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.607986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-d8ac20e3-6932-4c43-b8f9-9754fc4dfb63 req-a8904f77-ceaa-4ae7-8c6a-59a3dc3d4f07 service nova] Creating event network-vif-plugged:de553ab6-e238-403d-827d-b143492c1232 for instance 5b161895-21f1-4c71-9f5f-4d521eaea323 on hv-cinder-79123 May 24 10:02:15.613458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-d8ac20e3-6932-4c43-b8f9-9754fc4dfb63 req-a8904f77-ceaa-4ae7-8c6a-59a3dc3d4f07 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045609 May 24 10:02:15.614635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 102/216] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:15.620687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:15.632416 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:15.641636 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.642333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.643706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.644307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.823981 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:15.838758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-db217eec-47b7-4432-b4e1-643fe5cb05cd tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.500213 May 24 10:02:15.841385 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 115/217] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:15 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:15.906610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:15.918479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6f1ba865-409c-45e6-96e7-e1aec1cd0427 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.302443 May 24 10:02:15.919388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 103/218] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:15 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:15.936360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:15.937564 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:15.949798 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.950428 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:15.951568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:15.952182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.457162 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:16.467434 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:16.482794 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:16.484349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b5abbf9e-b5ca-4f01-97bd-d6b8d207dc37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.561141 May 24 10:02:16.485082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 116/219] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:15 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:16.583906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:16.584584 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:16.592540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.592999 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.593829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.594281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.798817 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:16.809428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-741e4012-a06f-4b3e-8cfa-82db32648396 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.228684 May 24 10:02:16.809428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 104/220] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:16 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:16.855826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:16.856594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:16.863907 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.864377 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.866159 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.866159 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.935843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:16.937805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:16.946307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.947151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:16.948189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:16.948835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:17.207234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:17.223504 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-68243c13-4def-4814-80a3-4bc98ab1f086 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.368165 May 24 10:02:17.233657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 117/221] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:16 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:17.251064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:17.253823 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7fc178e7-806a-4101-9566-96dd2f711db9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.322440 May 24 10:02:17.254888 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 105/222] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:16 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:17.502955 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:17.506350 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:17.512871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:17.513361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:17.514362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:17.514959 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:17.744075 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:17.758888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:17.761078 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:17.762650 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2e7e2090-cdbf-4840-a4ae-22a9b4c3c348 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.264747 May 24 10:02:17.763928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 118/223] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:17 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:17.825665 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:17.826579 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:17.833978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:17.834436 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:17.835400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:17.835750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.069383 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:18.077940 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6badd4c3-0286-46dd-814a-df5451a38779 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.256038 May 24 10:02:18.078515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 106/224] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:17 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:18.241779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:18.242505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:18.251174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.251893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.252836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.253464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.274190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:18.276267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:18.297402 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.298215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.300278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.301293 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.572774 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:18.584895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-961dc026-d839-4c45-b45e-6ca9487e36fc tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.347219 May 24 10:02:18.585909 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 119/225] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:18 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:18.624478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:18.636396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-84115b32-af3b-437f-b745-97bf7fe8eff9 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.366040 May 24 10:02:18.636396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 107/226] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:18 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:18.786600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:18.786600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:18.791025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.791025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:18.792302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:18.793009 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.000123 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.013004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.013004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.013004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-754bc133-fe32-4374-a825-69bfbf616686 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.233137 May 24 10:02:19.013424 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 120/227] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:18 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:19.098979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:19.099592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:19.107012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.107458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.108244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.108680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.324394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.333133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6544fae3-cf09-4408-a72e-2f65471dbacc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.238060 May 24 10:02:19.333726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 108/228] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:19 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:19.601167 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:19.601795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:19.609767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.610229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.611129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.611587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.651873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:19.652477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:19.660590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.660965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.664124 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:19.664124 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:19.905165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.914108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2621ac49-fce6-4622-96f6-0e8e22701805 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.266429 May 24 10:02:19.914958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 109/229] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:19 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:19.952956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:19.961328 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b53b49dd-b54e-4fd7-b478-fb44007d4a09 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.363790 May 24 10:02:19.962410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 121/230] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:19 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:20.029878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:20.030683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:20.038114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.038567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.039348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.039835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.247921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:20.256748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:20.258290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:20.259435 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e0e06b98-183e-48b1-a2fe-d82e935c2c84 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.234338 May 24 10:02:20.260064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 110/231] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:20 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:20.349787 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:20.350405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:20.358909 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.359291 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.360085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.360530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.559380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:20.567853 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2ae0fdc3-c1c9-4081-83df-6dc4b3c515fa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.221785 May 24 10:02:20.568432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 122/232] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:20 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:20.931351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:20.932669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:20.940258 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.940718 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.941591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.942032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.978587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:20.979785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:20.987126 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.987593 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:20.988527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:20.988969 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:21.172498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.181267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ad6a55de-4ed6-4125-b6d4-d6127ec1cf95 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.253327 May 24 10:02:21.182580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 111/233] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:20 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:21.198266 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.209830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f22df52b-f546-45aa-81dc-8b5a603f15e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.233274 May 24 10:02:21.209830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 123/234] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:20 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:21.277277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:21.277888 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:21.284955 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:21.285446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:21.286221 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:21.286654 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:21.497830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.506948 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.508467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.509683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1fcaee01-1a5f-43e6-b753-55fab51905e0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.236181 May 24 10:02:21.510397 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 112/235] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:21 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:21.584950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:21.585610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:21.592974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:21.593464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:21.594249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:21.594726 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:21.799888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:21.809533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-602000f8-75a0-420a-b900-0b56d2072957 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.228166 May 24 10:02:21.810626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 124/236] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:21 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:22.199095 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:22.199821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:22.207338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.207797 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.208597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.209559 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.224554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:22.227297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:22.265252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.265252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.265252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.265252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.466086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:22.475562 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-913eeac5-53f9-4324-8198-ac486070de47 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.280326 May 24 10:02:22.476347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 113/237] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:22 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:22.525973 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:22.527965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:22.528719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:22.543264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.543899 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.544846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.549404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.554886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-164fe730-aafd-45b0-813b-5064ae3eadb4 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.333822 May 24 10:02:22.555547 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 125/238] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:22 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:22.766114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:22.779292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:22.781034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:22.782204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4c98b024-3b0b-43b7-ad92-21cd6aa95590 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.258390 May 24 10:02:22.782911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 114/239] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:22 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:22.828082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:22.828705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:22.837208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.837208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.837728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.838722 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:22.982069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9ebdbb5e-3195-4c20-8c33-58504042be96 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:22.991557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ebdbb5e-3195-4c20-8c33-58504042be96 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:22.992235 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ebdbb5e-3195-4c20-8c33-58504042be96 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.057911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9ebdbb5e-3195-4c20-8c33-58504042be96 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Going to try to stop instance {{(pid=123672) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 24 10:02:23.076884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:23.087337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5b5f6ca4-fbaa-495f-bf13-aa0a0643d581 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.263058 May 24 10:02:23.090371 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 126/240] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:22 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:23.307522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9ebdbb5e-3195-4c20-8c33-58504042be96 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.328908 May 24 10:02:23.308478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 115/241] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:22 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:02:23.318412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:23.319085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:23.330496 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.331216 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.332237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.332835 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.492511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:23.493535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:23.501945 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.502403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.503356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.503801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.568378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:23.578476 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8e22fccd-796f-4749-a4b4-3639ab2e943d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.265142 May 24 10:02:23.579353 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 127/242] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:23 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:23.583937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:23.584708 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:23.592172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.592630 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.593453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.593901 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.721673 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:23.730580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-12a6214a-af1b-4591-8206-823ad5048fe6 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.242224 May 24 10:02:23.731168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 116/243] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:23 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:23.799710 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:23.802208 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:23.803045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:23.809104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2f57955b-b9a0-4c0d-917d-3ec03df455ce tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.228568 May 24 10:02:23.809690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 128/244] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:23 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:23.812770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.813201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:23.814092 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:23.814726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.021803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:24.031659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:24.033333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:24.034672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8afef5a1-7d3d-4c93-a87a-3fc8adc436e6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1745 microversion: 2.20 time: 0.236772 May 24 10:02:24.035328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 117/245] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:23 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:24.108872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:24.109579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:24.122672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.123109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.126203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.126718 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.145982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-a3ebf84a-2286-40a8-9970-d2c7ad2b1aba req-6f83e29d-3f69-4ba7-a751-5faf7a569bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea541a-eca6-424a-be23-a7324dd192c7", "name": "network-vif-plugged", "status": "completed", "tag": "c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:24.147805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:24.147805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:24.158748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a3ebf84a-2286-40a8-9970-d2c7ad2b1aba req-6f83e29d-3f69-4ba7-a751-5faf7a569bda service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.159387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a3ebf84a-2286-40a8-9970-d2c7ad2b1aba req-6f83e29d-3f69-4ba7-a751-5faf7a569bda service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.182612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-a3ebf84a-2286-40a8-9970-d2c7ad2b1aba req-6f83e29d-3f69-4ba7-a751-5faf7a569bda service nova] Creating event network-vif-plugged:c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde for instance c8ea541a-eca6-424a-be23-a7324dd192c7 on hv-cinder-79123 May 24 10:02:24.184332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-a3ebf84a-2286-40a8-9970-d2c7ad2b1aba req-6f83e29d-3f69-4ba7-a751-5faf7a569bda service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041874 May 24 10:02:24.185580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 118/246] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:24.448101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:24.457560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6f28fc0f-02f3-4772-a4df-6ce584ade695 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.357134 May 24 10:02:24.468922 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 129/247] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:24 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:24.596803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:24.597685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:24.607136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.607594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.608425 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.609444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.750864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:24.752050 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:24.762625 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.763746 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.765397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.767372 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.842628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:24.852097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-415a97bb-0e2b-45d8-8a0d-59d86942be69 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.259929 May 24 10:02:24.852687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 119/248] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:24 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:24.858276 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:24.859412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:24.868067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.868647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:24.869632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:24.870058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.120352 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.122950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.132099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4f370bfa-67f3-4550-bbe9-c0c75979bcde tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1315 microversion: 2.1 time: 0.388632 May 24 10:02:25.141386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 130/249] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:24 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:25.141516 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6ce06315-81ac-4091-b7af-71358db7cac1 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.278874 May 24 10:02:25.141516 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 120/250] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:24 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:25.141683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:25.141683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:25.147056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.147521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.148317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.148785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.375080 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.381140 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.382628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.386545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-881c3ce2-97e3-4a66-8bed-91192fcbd441 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.252346 May 24 10:02:25.397246 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 131/251] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:25 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:25.479438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:25.483601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:25.494988 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.495805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.497409 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.498493 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.791029 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:25.802320 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-71554155-6cec-439e-8c63-da738fa2cfd5 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.330147 May 24 10:02:25.804161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 121/252] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:25 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:25.870678 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:25.872484 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:25.891391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.893433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:25.896489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:25.897657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.150712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:26.151335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:26.163886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.165289 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.169934 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:26.171422 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.171898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.187687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f4c8689c-8fcd-42f3-8e48-1bacb2c00040 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.314124 May 24 10:02:26.202282 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 132/253] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:25 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:26.212012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:26.214189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:26.234579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.236515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.236515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.236515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.599043 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:26.612663 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7f6e35b6-538b-48db-824b-210a9679dc14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1464 microversion: 2.1 time: 0.465725 May 24 10:02:26.613561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 122/254] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:26 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1464 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:26.618736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b09368d-88d6-4178-8690-92edbf156805", "name": "network-vif-plugged", "status": "completed", "tag": "5479c5f8-df8c-4e32-9a54-3dff2b992272"}, {"server_uuid": "e740327b-669e-49e2-9b7c-1f72d272e5e4", "name": "network-vif-plugged", "status": "completed", "tag": "c7f85b81-de77-4ee2-8223-a1fb751791f5"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:26.620961 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:26.620961 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:26.633282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.633282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.663899 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] Creating event network-vif-plugged:5479c5f8-df8c-4e32-9a54-3dff2b992272 for instance 5b09368d-88d6-4178-8690-92edbf156805 on hv-cinder-79123 May 24 10:02:26.664702 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] Creating event network-vif-plugged:c7f85b81-de77-4ee2-8223-a1fb751791f5 for instance e740327b-669e-49e2-9b7c-1f72d272e5e4 on hv-cinder-79123 May 24 10:02:26.674545 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-f59e3772-68e4-408a-9c60-5c0e2c8d62bd req-62b1362c-fdf0-4970-aaae-a1c0d0089066 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059387 May 24 10:02:26.676027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 123/255] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:26.683723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:26.684577 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:26.710690 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.712424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.716670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.717553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.765367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:26.778238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b796e369-572f-40dd-bc8b-0daf555fa42d tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.574668 May 24 10:02:26.782264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 133/256] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:26 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:26.794523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:26.797601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:26.815081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.820960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.822628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:26.825166 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:26.959232 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:02:27.225599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:27.241686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:27.243337 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:27.244591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7a1d20cc-7d3a-4a01-96d6-b7038cf3b3a9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.567233 May 24 10:02:27.250235 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 124/257] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:26 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:27.263748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:27.264377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:27.282617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.283230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:27.284883 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.285370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:27.551925 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-78602f70-0293-43a4-91e3-4c2b7da68e0c tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 204 len: 0 microversion: 2.1 time: 0.767859 May 24 10:02:27.559023 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 134/258] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:02:26 2021] DELETE /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:02:27.560936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:27.561808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:27.588373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.588373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:27.588373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.588373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:27.725716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:27.745865 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-56b90044-3af7-45eb-8215-4c7f6089f4c8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.494236 May 24 10:02:27.746866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 125/259] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:27 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:27.752960 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:27.758289 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:27.778960 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.779427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:27.780266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:27.780729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.057694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.069599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-229c6c80-c3a6-4439-b233-926624cc69ec tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.514313 May 24 10:02:28.072924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 135/260] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:27 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:28.078085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:28.078721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:28.088310 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.089485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.090727 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.091178 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.250989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.262927 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-705c3ec3-e136-4172-905a-1680bb623fea tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1470 microversion: 2.1 time: 0.514804 May 24 10:02:28.281234 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 126/261] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:27 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:28.287282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:28.288151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:28.304977 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.308238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.309154 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.309619 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.513296 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.521894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1cd27412-8f65-45ac-b914-d4108e7712e0 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1314 microversion: 2.1 time: 0.447850 May 24 10:02:28.531625 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 136/262] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:28 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:28.696515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-3f07207d-077d-4594-9ae7-92c2c1246eb4 req-76f11006-ff9c-4357-a54f-c538c6da4af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "name": "network-vif-plugged", "status": "completed", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:28.700607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:28.700607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:02:28.712052 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3f07207d-077d-4594-9ae7-92c2c1246eb4 req-76f11006-ff9c-4357-a54f-c538c6da4af9 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.713127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3f07207d-077d-4594-9ae7-92c2c1246eb4 req-76f11006-ff9c-4357-a54f-c538c6da4af9 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.748097 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-3f07207d-077d-4594-9ae7-92c2c1246eb4 req-76f11006-ff9c-4357-a54f-c538c6da4af9 service nova] Creating event network-vif-plugged:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:02:28.753209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-3f07207d-077d-4594-9ae7-92c2c1246eb4 req-76f11006-ff9c-4357-a54f-c538c6da4af9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060319 May 24 10:02:28.754211 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 137/263] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:02:28.764233 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:28.765831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:28.782976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.784244 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.785434 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:28.786154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:28.815903 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.841162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.844730 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:28.846203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-89917f97-2de3-424f-9483-0ae73b340296 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.563892 May 24 10:02:28.851536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 127/264] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:28 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:29.045645 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:29.059814 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f864de77-0a17-4391-bd37-dce8cf379850 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1321 microversion: 2.1 time: 0.298978 May 24 10:02:29.073249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 138/265] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:28 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:29.094064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:29.094670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:29.118539 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.119763 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.121030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.121531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.280554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:29.281670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:29.290947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.294819 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.295730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.296196 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.600099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:29.613997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7c969c4f-08e0-4e19-9fc2-7db9d9917c14 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1470 microversion: 2.1 time: 0.336817 May 24 10:02:29.614747 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 139/266] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:29 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1470 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:29.615463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:29.631347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:29.631347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:29.631347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.631911 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.633183 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.633297 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a27be366-b2ee-45ab-b970-15518c69ca3d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.545574 May 24 10:02:29.633831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.641602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 128/267] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:29 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:29.867820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:29.874487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:29.884080 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.887808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.889215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:29.890253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:29.893606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:29.901382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a0f24c24-2a2f-41d0-a678-611b8bb2a6f5 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1497 microversion: 2.1 time: 0.285307 May 24 10:02:29.902775 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 140/268] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:29 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:30.084730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:30.087294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:30.102852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.113879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:30.120354 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.120824 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:30.424694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:30.435329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1347ebb9-6255-4a32-a479-311ff182af66 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1514 microversion: 2.1 time: 0.354511 May 24 10:02:30.445117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 141/269] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:30 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:30.471098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:30.474095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:30.480520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:30.502742 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.503216 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:30.505840 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.506176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:30.508472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:30.512922 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:30.514675 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e1be33a0-4bb5-4831-b65d-e2384f98fd76 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.650863 May 24 10:02:30.518553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 129/270] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:29 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:30.631665 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:30.632339 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:30.647037 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.651596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lazy-loading 'flavor' on Instance uuid e740327b-669e-49e2-9b7c-1f72d272e5e4 {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:02:30.657633 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:30.658879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:30.659342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.180965 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9d118837-854b-4a58-9a1d-3dd0485d1122 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4/action" status: 200 len: 32 microversion: 2.1 time: 0.726968 May 24 10:02:31.190051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 142/271] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:02:30 2021] POST /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4/action => generated 32 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:02:31.192253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:31.210685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:31.216754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:31.237326 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-04fc18b0-dfbc-46cd-877a-825026f73e10 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1428 microversion: 2.1 time: 0.589963 May 24 10:02:31.237326 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 130/272] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:30 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1428 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:31.243103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:31.243872 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:31.244593 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.249263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.253162 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.253162 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.258219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.264682 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.266466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.266466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.716133 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:31.726549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9c45459c-d4d1-47ff-9adc-a291cd388ca3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.542785 May 24 10:02:31.738453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 143/273] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:31 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:31.743793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-bbcc18f7-de39-46e5-b1ef-a071187b4289 req-5afd4c1e-612d-4d37-bfc5-1fc8c5640943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea541a-eca6-424a-be23-a7324dd192c7", "name": "network-vif-deleted", "tag": "c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:31.746082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:31.746082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:02:31.760456 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-bbcc18f7-de39-46e5-b1ef-a071187b4289 req-5afd4c1e-612d-4d37-bfc5-1fc8c5640943 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.761092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-bbcc18f7-de39-46e5-b1ef-a071187b4289 req-5afd4c1e-612d-4d37-bfc5-1fc8c5640943 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.781505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-bbcc18f7-de39-46e5-b1ef-a071187b4289 req-5afd4c1e-612d-4d37-bfc5-1fc8c5640943 service nova] Creating event network-vif-deleted:c643f4f5-6c4c-4b8b-8ba5-cbe94def0fde for instance c8ea541a-eca6-424a-be23-a7324dd192c7 on hv-cinder-79123 May 24 10:02:31.786998 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-bbcc18f7-de39-46e5-b1ef-a071187b4289 req-5afd4c1e-612d-4d37-bfc5-1fc8c5640943 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046886 May 24 10:02:31.788150 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 144/274] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:31.796404 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:31.797419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:31.805842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.806454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.807333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:31.807856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:31.929990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:31.929990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c81aefec-746a-4dcd-9d18-bd3fe4ab469f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.693787 May 24 10:02:31.929990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 131/275] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:31 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:32.058812 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:32.076474 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:32.079010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:32.081782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b2727390-121e-420b-84a0-d67627c3f2c5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.291342 May 24 10:02:32.087488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 145/276] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:31 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:32.244394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:32.245152 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:32.282164 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.283581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.285330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.286864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.442541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.443369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.444851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lazy-loading 'fault' on Instance uuid c8ea541a-eca6-424a-be23-a7324dd192c7 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:02:32.483632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:32.484197 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:32.492514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.492980 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.494634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.495088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.587469 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:02:32.768619 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7296cf36c94b91bde76813acee1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa03a8a310f4bf9ba9e8166f64c9983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:32.784799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-396c442c-aed7-4d1c-bb80-c745a2f81702 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 200 len: 1305 microversion: 2.1 time: 0.542289 May 24 10:02:32.784799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 132/277] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:32 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 1305 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:32.797488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:32.798027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:32.814915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.815635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:32.816631 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:32.817261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.115636 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.144494 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-231252d3-b93f-4f68-9116-95b2d07145a7 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 204 len: 0 microversion: 2.1 time: 0.671497 May 24 10:02:33.146063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 146/278] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:02:32 2021] DELETE /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:02:33.150794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2a6d4612-155f-4947-b72a-b214cc4c1475 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.353778 May 24 10:02:33.152707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:33.153654 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:33.155278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 133/279] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:32 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:33.165335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.165335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.170714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.171626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.181458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:33.190610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:33.208587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.209020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.209887 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.213022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.446594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.467149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4af74177-9488-4345-8650-c9f5a63faa2f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.318897 May 24 10:02:33.476340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 147/280] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:33 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:33.485584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:33.493196 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:33.506292 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.510696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.510696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.511579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.639403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.651362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.653969 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.661041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ab38bf5f-5c1d-40b4-9e83-0fd889786ffc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.485680 May 24 10:02:33.661041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 134/281] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:33 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:33.803420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:33.803420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] [instance: c8ea541a-eca6-424a-be23-a7324dd192c7] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:33.811110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.812188 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.813189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:33.813918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:33.843708 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:33.854007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b550e2a6-eb4c-470a-9343-1ec5455c7d2c tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1503 microversion: 2.1 time: 0.375961 May 24 10:02:33.855113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 148/282] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:33 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:33.871121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] HTTP exception thrown: Instance c8ea541a-eca6-424a-be23-a7324dd192c7 could not be found. May 24 10:02:33.872028 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] Returning 404 to user: Instance c8ea541a-eca6-424a-be23-a7324dd192c7 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:02:33.873351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cc1dc7d6-3fc4-4297-92f3-5f908a1fdcd1 tempest-VolumesNegativeTest-766272021 tempest-VolumesNegativeTest-766272021-project] 10.222.0.67 "GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7" status: 404 len: 111 microversion: 2.1 time: 0.076821 May 24 10:02:33.874444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 135/283] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:33 2021] GET /compute/v2.1/servers/c8ea541a-eca6-424a-be23-a7324dd192c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:02:34.176505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:34.176505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:34.185813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.186521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.187523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.187995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.490696 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:34.491963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:34.501003 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.501936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.502787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.503365 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.570752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:34.580666 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1daf1a57-f992-4e8c-bd2e-7a4476d93b87 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.411216 May 24 10:02:34.592457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 149/284] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:34 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:34.673028 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:34.674684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:34.688875 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.689852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.693818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.694592 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.877915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:34.889517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9176ff0d-7488-4a8b-a8a9-e20a6ca87976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.410201 May 24 10:02:34.893693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 136/285] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:34 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:34.898556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:34.901012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:34.920819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.931896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:34.937456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:34.937456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:35.032138 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:35.047664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:35.053410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:35.057886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0f7086f3-859e-4ca6-8a21-7f6af18b2c4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.387190 May 24 10:02:35.070055 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 150/286] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:34 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:35.512525 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:35.522073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bab34692-c8f9-4fed-9aef-6bd1a6960df8 tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1503 microversion: 2.1 time: 0.626571 May 24 10:02:35.523259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 137/287] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:34 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1503 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:35.604555 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:35.605389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:35.615832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:35.616394 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:35.617457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:35.618071 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:35.925991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:35.945090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:35.945090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:35.945090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:35.945090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:35.945461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.108259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.138161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-da8e8723-5112-4f14-a353-bc1455c197a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.539249 May 24 10:02:36.148816 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 151/288] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:35 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:36.157231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:36.166624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:36.186800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:36.187378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.188307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:36.188880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.273644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.288656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8596653a-b70e-441e-86a1-fa5ec105fe1b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.367124 May 24 10:02:36.292641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 138/289] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:35 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:36.542875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-2257d377-3913-436f-a77b-64ebff276d2e req-d3ba788c-f0f2-4b11-9bfb-5e217670bacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b09368d-88d6-4178-8690-92edbf156805", "name": "network-vif-deleted", "tag": "5479c5f8-df8c-4e32-9a54-3dff2b992272"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:36.544723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:36.544723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:36.562817 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-2257d377-3913-436f-a77b-64ebff276d2e req-d3ba788c-f0f2-4b11-9bfb-5e217670bacd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:36.563271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-2257d377-3913-436f-a77b-64ebff276d2e req-d3ba788c-f0f2-4b11-9bfb-5e217670bacd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.564769 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.579912 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.582346 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-2257d377-3913-436f-a77b-64ebff276d2e req-d3ba788c-f0f2-4b11-9bfb-5e217670bacd service nova] Creating event network-vif-deleted:5479c5f8-df8c-4e32-9a54-3dff2b992272 for instance 5b09368d-88d6-4178-8690-92edbf156805 on hv-cinder-79123 May 24 10:02:36.582507 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.586013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6be8244c-9f55-445c-ba20-4b3510b4a6e9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.432986 May 24 10:02:36.588332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 152/290] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:36 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:36.592941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:36.594716 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:36.600123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-2257d377-3913-436f-a77b-64ebff276d2e req-d3ba788c-f0f2-4b11-9bfb-5e217670bacd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061289 May 24 10:02:36.603900 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 139/291] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:36.606405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:36.606873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.607564 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:36.608037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:36.725286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ea6bdc02bf40779bab79ba54e04cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f38795dc42f4d5186770d3b222547ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:36.734284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f980f9d4-ce0f-44cf-9057-2f1474ca6e8e tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 200 len: 1461 microversion: 2.1 time: 0.144964 May 24 10:02:36.734851 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 153/292] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:36 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 1461 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:37.158075 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:37.158928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:37.171951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.173883 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.175774 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.176626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.315344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:37.315957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:37.324406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.324969 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.326047 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.326575 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.608625 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:37.624830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-63e16efa-5de3-438d-b9d4-ee04e980606d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.472614 May 24 10:02:37.626010 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 140/293] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:37 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:37.631419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:37.632307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:37.643467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.651088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.651088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.651088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.810300 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:37.842314 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-85282006-f5dd-4bd9-8aae-2baba425f439 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.538365 May 24 10:02:37.852008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 154/294] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:37 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:37.859584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:37.859584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] [instance: 5b09368d-88d6-4178-8690-92edbf156805] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:37.870810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.870810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.874370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:37.875360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:37.944995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] HTTP exception thrown: Instance 5b09368d-88d6-4178-8690-92edbf156805 could not be found. May 24 10:02:37.945881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] Returning 404 to user: Instance 5b09368d-88d6-4178-8690-92edbf156805 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:02:37.946880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-417ea89d-30d8-49c4-9180-ace38a2b453b tempest-VolumesActionsTest-1211716999 tempest-VolumesActionsTest-1211716999-project] 10.222.0.67 "GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805" status: 404 len: 111 microversion: 2.1 time: 0.093640 May 24 10:02:37.947553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 155/295] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:37 2021] GET /compute/v2.1/servers/5b09368d-88d6-4178-8690-92edbf156805 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:02:37.948629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:37.960184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:37.960945 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:37.962705 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c6272382-774c-4c1c-90ea-d794194581a0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.335579 May 24 10:02:37.963711 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 141/296] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:37 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:38.645976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:38.646879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:38.662754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:38.663259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:38.664591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:38.666073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:38.858762 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:38.859483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:38.867759 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:38.868442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:38.869401 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:38.873701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:39.154585 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:39.171579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6a181065-27ce-4705-804f-1515b087fc1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.531218 May 24 10:02:39.174781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 156/297] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:38 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:39.189599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:39.192622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:39.210899 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:39.213276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:39.220743 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:39.221543 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:39.247370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:39.261821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e7d9f16b-cbbb-4147-8011-e796ae231086 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.406803 May 24 10:02:39.263676 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 142/298] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:38 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:39.769820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:39.802963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:39.806414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:39.812685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-90914231-6fc9-4bc7-bc9e-cb1a7d829d2a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.631718 May 24 10:02:39.815181 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 157/299] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:39 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:40.195776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:40.206111 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:40.229925 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.230741 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:40.232323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.234271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:40.280049 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:40.280674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:40.319793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.321474 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:40.323739 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.328002 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:40.652801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:40.663014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-07c6a5b9-5904-46c2-a2f3-f4aff301fc70 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.475698 May 24 10:02:40.679733 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 143/300] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:40 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:40.715268 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:40.727790 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f47e7c0b-92cb-49b7-a0d7-d314a8d01de1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.451631 May 24 10:02:40.729758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 158/301] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:40 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:40.836114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:40.836921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:40.845592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.846420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:40.847305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:40.848019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:41.082626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:41.096426 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:41.100117 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:41.172553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-341e0a0a-a655-427b-83c3-6f9662743e8a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.269917 May 24 10:02:41.172553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 144/302] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:40 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:41.683684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:41.684289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:41.703573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:41.704032 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:41.704832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:41.705346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:41.747701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:41.748322 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:41.756978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:41.757462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:41.758279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:41.758726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:42.015603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:42.024434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-398a4c4d-3292-4ad6-b9c2-5e97ecb863c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.281319 May 24 10:02:42.029457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 145/303] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:41 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:42.033039 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:42.050581 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-41af8f0b-2625-4469-b0bb-9c375d3f4b09 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.371097 May 24 10:02:42.055325 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 159/304] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:41 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:42.145588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:42.146370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:42.160862 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:42.161597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:42.162668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:42.164011 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:42.450007 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:42.459787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:42.462237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:42.464127 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-60ae2167-2a44-4302-9582-d88c42955a92 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.325068 May 24 10:02:42.476643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 146/305] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:42 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:43.052729 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:43.054531 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:43.066205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.066935 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.068800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.069560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.074854 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:43.076920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:43.092342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.093167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.097956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.097956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.344033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:43.356317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-db8dda38-f84e-4c0a-a068-f7f1cade4ad7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.288825 May 24 10:02:43.357681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 147/306] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:43 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:43.378163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:43.390866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ea0c602e-db7b-45b5-bdde-0c6fbfee9f86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.345631 May 24 10:02:43.391566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 160/307] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:43 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:43.485520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:43.486323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:43.498368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.498843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.499655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:43.500104 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:43.619421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1276477572", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "2852c3dc-6508-45a7-9576-a36787475d18"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:43.832840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:43.843441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:43.844804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:43.846203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-46d293fd-e815-4fc4-8571-c39e3d2539bc tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1740 microversion: 2.20 time: 0.367127 May 24 10:02:43.857271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 148/308] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:43 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:44.095797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] validate_networks() for [('2852c3dc-6508-45a7-9576-a36787475d18', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:02:44.375128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:44.375604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:44.384825 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.385318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.386157 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.386597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.732160 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:44.741229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6161ef94-0d7a-4519-9cf4-fc0ea2d5bfd3 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.370910 May 24 10:02:44.750768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 149/309] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:44 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:44.755683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:44.756306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:44.764373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.764827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.765923 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.766160 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.835685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:02:44.836318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:02:44.836981 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:02:44.838149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:02:44.838761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:02:44.851839 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.852473 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.853661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:44.854310 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:44.877624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Getting quotas for project 0fa87500244642ee805dba47191bc7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:02:44.884042 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Getting quotas for user 87c525da11c94e1bb14cf55dda4c3cae and project 0fa87500244642ee805dba47191bc7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:02:44.898355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:02:44.902476 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:02:44.985618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:44.995072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-22e4bb6a-3416-4fca-939b-3f834962b868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.243025 May 24 10:02:45.001200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 150/310] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:44 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:45.001200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:45.001200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:45.008930 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:45.010192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:45.010987 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:45.011429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:45.087087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a73fa4bb-dc69-415c-88f5-40aa9a00bba3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471528 May 24 10:02:45.088408 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 161/311] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:02:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:02:45.098553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-22c977a7-a922-446b-b628-4e00bba43804 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:45.099239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-22c977a7-a922-446b-b628-4e00bba43804 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:45.186334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-22c977a7-a922-446b-b628-4e00bba43804 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:45.194295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-22c977a7-a922-446b-b628-4e00bba43804 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1219 microversion: 2.1 time: 0.099452 May 24 10:02:45.194890 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 162/312] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:45 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:45.253775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:45.269927 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:45.271880 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:45.273258 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-de4a3576-160b-4db7-903b-3d0505840a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.276322 May 24 10:02:45.274149 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 151/313] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:44 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:45.758076 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:45.758800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:45.767360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:45.767889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:45.768847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:45.769373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:45.976607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:45.987363 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-79a4dacb-e07f-4077-be12-6f33822fb4d1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.232974 May 24 10:02:45.988323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 163/314] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:45 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:46.016212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:46.016837 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:46.024268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:46.024718 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:46.025605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:46.026046 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:46.211661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4d6432ae-1d2a-444f-9a2c-445de218803e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:46.213405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4d6432ae-1d2a-444f-9a2c-445de218803e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:46.232763 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:46.244444 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a438aad2-fa5b-4774-a9b3-3a93dfbf31d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.231180 May 24 10:02:46.254431 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 152/315] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:46 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:46.287580 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4d6432ae-1d2a-444f-9a2c-445de218803e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:46.293325 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:46.294626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:46.299977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4d6432ae-1d2a-444f-9a2c-445de218803e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1219 microversion: 2.1 time: 0.093023 May 24 10:02:46.300561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 164/316] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:46 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:46.301974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:46.302430 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:46.303225 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:46.303982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:46.511844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:46.521126 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:46.522857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:46.523991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b3abffab-bf16-412e-a2d2-91d85e30a2d5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.235751 May 24 10:02:46.524538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 153/317] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:46 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:47.007443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:47.008271 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:47.016806 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.017301 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.018089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.018534 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.231996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:47.241217 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-dc703145-c373-47a6-9099-b8d148be2f24 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.238912 May 24 10:02:47.241537 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 165/318] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:47 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:47.263460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:47.266137 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:47.273647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.274317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.275351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.275822 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.317486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:47.318100 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:47.326602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.327152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.327918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.328365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.474561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:47.488318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-15b55cb0-5d47-49d1-b50a-58846a37eaa8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1223 microversion: 2.1 time: 0.174406 May 24 10:02:47.498690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 166/319] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:47 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:47.545227 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:47.545227 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:47.551587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.552099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.553085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:47.553685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:47.651666 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:47.673605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0b8c7545-9323-4fdc-be0d-7c7f63fefd75 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.413372 May 24 10:02:47.674419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 154/320] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:47 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:47.992895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:48.008720 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:48.010471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:48.013188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1d56d22d-85f9-4c60-898a-80491a5d0d14 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.475093 May 24 10:02:48.015644 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 167/321] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:47 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:48.258440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:48.258905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:48.271497 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.271972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.272745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.273257 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.506852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:48.507487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:48.519393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.519393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.519863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.528837 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.805033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:48.822433 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a557505b-b741-4c50-8369-4817145284cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.566660 May 24 10:02:48.823806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 155/322] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:48 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:48.828547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:48.830550 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:48.838884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.839658 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.840885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:48.841503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:48.999252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:49.011095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-dfad190e-89f8-4e19-9b64-ba542707a845 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1271 microversion: 2.1 time: 0.507766 May 24 10:02:49.026660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 168/323] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:48 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1271 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:49.036023 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:49.037124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:49.051780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:49.054067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:49.055117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:49.057256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:49.417874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:49.430939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:49.436373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:49.441800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f31cdfca-90cf-46e1-bf94-a885de21af4c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.409638 May 24 10:02:49.443006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 169/324] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:49 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:49.680138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:49.699427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-42d140fd-5841-40bf-bd1d-4e612c094adf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.874346 May 24 10:02:49.706484 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 156/325] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:48 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:49.843886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:49.844520 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:49.855748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:49.856214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:49.857020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:49.857501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:49.980010 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-969d37ca-fd6e-4943-848b-e515ea28b8c8 req-7cf1fe30-2137-4070-9e62-ca408fc81362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "name": "network-vif-unplugged", "status": "completed", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:49.981771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:49.981771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:50.015690 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-969d37ca-fd6e-4943-848b-e515ea28b8c8 req-7cf1fe30-2137-4070-9e62-ca408fc81362 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.018306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-969d37ca-fd6e-4943-848b-e515ea28b8c8 req-7cf1fe30-2137-4070-9e62-ca408fc81362 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.068243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-969d37ca-fd6e-4943-848b-e515ea28b8c8 req-7cf1fe30-2137-4070-9e62-ca408fc81362 service nova] Creating event network-vif-unplugged:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:02:50.074566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-969d37ca-fd6e-4943-848b-e515ea28b8c8 req-7cf1fe30-2137-4070-9e62-ca408fc81362 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106189 May 24 10:02:50.080799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 157/326] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:02:50.095192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:50.097691 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:50.128543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.129224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.130148 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.130676 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.310549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:50.324520 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e368250d-0b29-4a6e-a78c-04eea6c189be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.484396 May 24 10:02:50.325979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 170/327] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:49 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:50.424786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:50.430338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-be77369a-9deb-423a-9ef7-dcb2fc9d50ff tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1277 microversion: 2.1 time: 0.347994 May 24 10:02:50.432168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 158/328] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:50 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1277 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:50.460949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:50.461609 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:50.472620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.473436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.476253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.476253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.723205 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:50.724587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:50.730490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:50.743218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:50.749661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:50.755106 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-03319d20-dd5e-473d-a1ac-fd42eb960a37 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.295155 May 24 10:02:50.755335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 171/329] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:50 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:50.763002 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.764990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:50.766427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:50.767256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.033567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:51.044077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5d6b038e-e325-40d6-971c-16711c52ce0e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.325234 May 24 10:02:51.044687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 159/330] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:50 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:51.346238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:51.346866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:51.358850 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.359815 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.360830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.361551 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.447684 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:51.448575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:51.459268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.460083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.461032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.465888 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.652379 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:51.663254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-929636a0-6a73-4212-8b2c-08c5889fc4df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.321537 May 24 10:02:51.674092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 172/331] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:51 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:51.788390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:51.820136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:51.820136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.820136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.820136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:51.846205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:51.940396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:51.971652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c19bc34b-ee06-4d6d-ba4d-7115f8ffe141 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.519179 May 24 10:02:51.988657 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 160/332] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:51 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:52.068062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:52.070106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:52.082517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:52.083227 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:52.084198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:52.084793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:52.233989 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:52.245885 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:52.247624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:52.248827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-036ba71a-dd14-457f-ab27-17e216702d08 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.470093 May 24 10:02:52.259925 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 173/333] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:51 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:52.346958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:52.356427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c5ddd8e8-feff-4d67-a09a-ab4e42919ad2 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.294495 May 24 10:02:52.357001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 161/334] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:52 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:52.682643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:52.683270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:52.693615 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:52.694154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:52.694994 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:52.705466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:52.943858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:52.955467 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-82708fe2-6432-4bd5-ba47-24f7ce8a11b7 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.276382 May 24 10:02:52.967261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 174/335] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:52 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:53.010370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:53.011410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:53.022481 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.023201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.028417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.029136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.266600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:53.267235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:53.280922 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.281834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.294784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.295436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.372769 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:53.382582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e789afdf-89aa-49af-ab70-7906d3171b11 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.387714 May 24 10:02:53.383912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 162/336] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:52 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:53.405779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:53.406466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:53.419470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.419952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.420790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.421281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.641847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:53.651918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:53.654132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:53.655504 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7b5ad1a4-55c6-4c36-81c8-d8787475458b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1722 microversion: 2.20 time: 0.392641 May 24 10:02:53.656199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 175/337] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:53 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:53.752420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:53.762584 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5da4b894-c97c-43c3-8f8c-2ec82562fcb3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.376813 May 24 10:02:53.772123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 163/338] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:53 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:53.975355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:53.976046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:53.998445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:53.999076 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:53.999863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:54.000707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:54.228522 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:54.238939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-60530bdd-09ee-42ba-adff-122cdcae396b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.268615 May 24 10:02:54.249378 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 176/339] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:53 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:54.400255 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:54.401565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:54.410300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:54.410781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:54.411566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:54.412011 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:54.676253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:54.677074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:54.694881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:54.695367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:54.696190 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:54.696674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:54.974308 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:54.988122 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-025a7962-9a6a-4757-8e10-ddccb1125f9d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.592167 May 24 10:02:54.989827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 164/340] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:54 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:55.011871 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:55.015819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:55.027993 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.030842 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:55.036396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.037311 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:55.199660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:55.211006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:55.212785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:55.214004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-df779680-c95a-4406-9f03-ec9d7ecf4267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1725 microversion: 2.20 time: 0.542590 May 24 10:02:55.214890 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 177/341] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:54 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1725 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:55.241596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "041337cb-949d-4467-a0fd-19278fbc3e6e"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:55.243454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:55.254176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.254904 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:55.255868 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.256313 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:55.528348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:55.544081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-78bf9f6c-30b3-4be8-99e0-d95720fc02cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.539938 May 24 10:02:55.555554 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 165/342] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:55 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:55.577329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:55.578377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:55.598698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.600860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:55.603484 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:55.606427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:56.134394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:56.149404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9ba9a76f-af62-416f-9b64-bd48f617296a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.591719 May 24 10:02:56.155796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 166/343] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:55 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:56.179387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-b15eb2bb-1a9f-4b80-b297-48bdbf002e3e req-0ab76877-960b-4282-b7b1-7fd704172650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61900f34-f721-4a3d-ad8c-ff38d86984fc", "tag": "855e6647-516e-462d-8d07-0f5cf828da14"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:56.186472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:02:56.186472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:02:56.245618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-b15eb2bb-1a9f-4b80-b297-48bdbf002e3e req-0ab76877-960b-4282-b7b1-7fd704172650 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:56.246161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-b15eb2bb-1a9f-4b80-b297-48bdbf002e3e req-0ab76877-960b-4282-b7b1-7fd704172650 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:56.282143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-b15eb2bb-1a9f-4b80-b297-48bdbf002e3e req-0ab76877-960b-4282-b7b1-7fd704172650 service nova] Creating event network-changed:855e6647-516e-462d-8d07-0f5cf828da14 for instance 61900f34-f721-4a3d-ad8c-ff38d86984fc on hv-cinder-79123 May 24 10:02:56.292338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-b15eb2bb-1a9f-4b80-b297-48bdbf002e3e req-0ab76877-960b-4282-b7b1-7fd704172650 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134654 May 24 10:02:56.293547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 167/344] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:02:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:02:56.307094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:56.307857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:56.320044 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:56.334126 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:56.337716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:56.340062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:56.700072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:56.727111 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-84e6f0e1-2d60-4985-9e44-d6c5162bb050 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.429834 May 24 10:02:56.729164 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 168/345] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:56 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:56.744958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:56.753668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:56.783424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:56.785231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:56.790334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:56.790334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.221905 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5c95f419-8de4-476d-a8ea-ba9937c0bb5b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.985651 May 24 10:02:57.223302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 178/346] 10.222.0.67 () {62 vars in 1364 bytes} [Mon May 24 10:02:55 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments => generated 188 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:02:57.236068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:57.237369 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:57.267270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.267854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.268863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.269705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.472369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:57.487388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-46f23a46-bfc9-459d-9452-aee5aa894980 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.756291 May 24 10:02:57.491107 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 169/347] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:56 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:57.568659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:02:57.570029 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:57.584508 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.584966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.590083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.590541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.667808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:57.679490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0b122037-8529-423d-b190-83136871c381 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.447270 May 24 10:02:57.680498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 179/348] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:57 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:57.753964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:57.754804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:57.772428 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.776006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.777115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:57.779087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:57.986250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7939995c-30b0-4e6f-8728-642df43d147f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action" status: 202 len: 0 microversion: 2.20 time: 0.421168 May 24 10:02:57.990897 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 170/349] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:02:57 2021] POST /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:02:58.007597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:58.007792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:58.038521 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.038948 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.039737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.040238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.344012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:58.357982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5adf6289-c42a-40e0-8a9c-c55c59fdc5a8 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.613981 May 24 10:02:58.358588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 180/350] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:57 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:58.460078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:58.474026 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:58.475750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:58.477024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-936459cb-5852-4cc1-8c99-54b9619719ea tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1751 microversion: 2.20 time: 0.485095 May 24 10:02:58.478897 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 171/351] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:57 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1751 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:02:58.504421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:58.505095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:58.515118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.515842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.517088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.517859 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.700678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:58.701771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:58.710619 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.711373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.713084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:58.713722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:58.795390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:58.835855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-09a14880-8ac7-437e-974e-88228140bd8c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.334101 May 24 10:02:58.840160 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 181/352] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:58 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:59.016826 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:59.046850 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2e18e307-8a24-42f7-a188-fcfe115b2bd8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1722 microversion: 2.1 time: 0.350165 May 24 10:02:59.051910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 172/353] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:58 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:02:59.379514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:59.380365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:59.402473 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.409545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:59.410350 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.410807 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:59.496091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:59.496717 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:59.508711 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.510594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:59.515635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.515635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:59.712648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:59.727019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f0234376-14c8-44ce-9235-db397202d265 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.354902 May 24 10:02:59.728840 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 182/354] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:59 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:02:59.788102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:59.807014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:59.808929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:02:59.810454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-914a08ec-8261-4a25-ae9a-c52d235bd65a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1751 microversion: 2.20 time: 0.318704 May 24 10:02:59.811110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 173/355] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:02:59 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1751 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:02:59.864250 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:02:59.864250 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:02:59.881530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.881990 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:02:59.882849 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:02:59.883315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:00.068019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:00.068483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:00.086443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:00.089675 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:00.090999 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:00.092387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:00.259134 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:00.270226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d0858dfc-0fd7-4acb-80b6-16cef3bc0b53 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.417997 May 24 10:03:00.271476 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 183/356] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:02:59 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:00.469544 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:00.488554 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-61c81420-1847-4223-ad1a-8edce6043151 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1699 microversion: 2.1 time: 0.423782 May 24 10:03:00.490131 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 174/357] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:00 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1699 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:00.508427 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-49b75e31-feeb-42fb-9c98-7692080b650d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:00.520848 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49b75e31-feeb-42fb-9c98-7692080b650d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:00.521334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49b75e31-feeb-42fb-9c98-7692080b650d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:00.626326 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-49b75e31-feeb-42fb-9c98-7692080b650d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Going to try to start instance {{(pid=123673) start /opt/stack/nova/nova/compute/api.py:2602}} May 24 10:03:00.748685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:00.750191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:00.760861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:00.764108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:00.764108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:00.764108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.131385 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.139939 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c23ec2df-159b-429b-9a1a-14627dfffbf4 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.397407 May 24 10:03:01.141944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 175/358] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:00 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:01.144796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:01.145438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:01.152833 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.153275 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.154058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.154509 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.191422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-49b75e31-feeb-42fb-9c98-7692080b650d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.688748 May 24 10:03:01.192203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 184/359] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:03:00 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:03:01.201995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:01.202832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:01.211044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.211584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.212726 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.213240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.388585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.400589 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.403033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.404692 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f3061944-d0ec-4ade-8f30-235293a24ee5 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1753 microversion: 2.20 time: 0.263152 May 24 10:03:01.405907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 176/360] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:01 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:01.410980 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:01.411950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:01.420806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.421432 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.422335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:01.423198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:01.613370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.632336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2aa010f0-3039-42e6-a250-5a2e5ace9279 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1708 microversion: 2.1 time: 0.435139 May 24 10:03:01.633996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 185/361] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:01 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1708 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:01.824593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:01.833421 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f06d5fdd-7945-47eb-bda9-7e378fc308a1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.426043 May 24 10:03:01.834956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 177/362] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:01 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:02.158465 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:02.159374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:02.173606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.174864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.175855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.176462 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.362170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-4825bb59-86b0-443d-a148-e552071c91bf req-ec826886-0674-4a84-9fa4-d32c2cbc43b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61900f34-f721-4a3d-ad8c-ff38d86984fc", "name": "network-vif-plugged", "status": "completed", "tag": "855e6647-516e-462d-8d07-0f5cf828da14"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:02.365009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:03:02.365009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:03:02.375765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-4825bb59-86b0-443d-a148-e552071c91bf req-ec826886-0674-4a84-9fa4-d32c2cbc43b8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.376849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-4825bb59-86b0-443d-a148-e552071c91bf req-ec826886-0674-4a84-9fa4-d32c2cbc43b8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.403912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-4825bb59-86b0-443d-a148-e552071c91bf req-ec826886-0674-4a84-9fa4-d32c2cbc43b8 service nova] Creating event network-vif-plugged:855e6647-516e-462d-8d07-0f5cf828da14 for instance 61900f34-f721-4a3d-ad8c-ff38d86984fc on hv-cinder-79123 May 24 10:03:02.412110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-4825bb59-86b0-443d-a148-e552071c91bf req-ec826886-0674-4a84-9fa4-d32c2cbc43b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054020 May 24 10:03:02.414078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 178/363] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:03:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:03:02.428187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:02.429027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:02.465747 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.466207 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.467021 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.467464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.529764 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:02.548009 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-97bfc3a0-b781-4dc3-bd57-4a589a404653 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.394678 May 24 10:03:02.563315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 186/364] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:02 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:02.650894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:02.652433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:02.666098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.666890 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:02.681127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:02.681127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:03.019917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.041371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.046325 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.047423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-62b3888f-be97-478e-ad8e-6d3aadc3f081 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1753 microversion: 2.20 time: 0.624005 May 24 10:03:03.048183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 179/365] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:02 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1753 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:03.059171 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:03.072890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:03.100769 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:03.101279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:03.102098 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:03.102548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:03.401881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.422046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4db0a0db-c008-4265-8cff-9787fd9e6715 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1708 microversion: 2.1 time: 0.775358 May 24 10:03:03.425228 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 187/366] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:02 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1708 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:03.452903 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.481218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-da9d37f9-53de-4b1f-b7b3-c7a0f419fac3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.414779 May 24 10:03:03.481218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 180/367] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:03 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:03.570488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:03.571141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:03.583026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:03.583026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:03.583026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:03.583026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:03.873586 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:03.900929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-55d621cb-7748-4526-966a-a1c2ba8f76d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1319 microversion: 2.1 time: 0.328703 May 24 10:03:03.902061 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 188/368] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:03 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:04.066776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:04.067745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:04.076097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.076651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.077740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.078405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.300371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:04.311845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:04.314083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:04.315892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5a4be26b-8ab8-48d8-aa91-2a72142888be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.252858 May 24 10:03:04.327462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 181/369] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:04 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:04.441738 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:04.442495 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:04.458942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.461662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.463212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.463212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.489458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:04.490781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:04.507963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.507963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.513862 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.514631 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.826125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:04.840397 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b4cb96da-16fa-4812-a6b4-132e67dac8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.353338 May 24 10:03:04.850939 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 182/370] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:04 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:04.921035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:04.921992 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:04.931465 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.932020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:04.933210 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:04.933729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:05.072389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:05.084082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cce2f8a7-86f1-44b5-997a-5bb2555f0d05 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1712 microversion: 2.1 time: 0.646287 May 24 10:03:05.096450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 189/371] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:04 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1712 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:05.308248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:05.317621 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4acb20be-06cc-4f11-9cd9-426ed2f6c124 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1508 microversion: 2.1 time: 0.400954 May 24 10:03:05.318192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 183/372] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:04 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:05.339397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:05.345765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:05.362538 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:05.363156 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:05.366718 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:05.367568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:05.757442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:05.770335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:05.772147 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:05.773810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-71ce482d-1273-4d10-9499-c6f01246a184 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.442467 May 24 10:03:05.774962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 190/373] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:05 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:05.862301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:05.866216 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:05.898621 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:05.900130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:05.901657 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:05.902979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:06.161957 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:06.172293 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9d5a993b-0230-428b-9a59-b790e3d72d33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1520 microversion: 2.1 time: 0.317459 May 24 10:03:06.173211 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 184/374] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:05 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:06.836100 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:06.836770 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:06.859245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:06.859993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:06.862516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:06.863285 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:07.190776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:07.191633 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:07.201736 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:07.213356 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:07.214722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:07.215195 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:07.215928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:07.216084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:07.216441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:07.218044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c581cc51-fa92-4e8f-9aa9-71d97d44a281 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.425737 May 24 10:03:07.219188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 191/375] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:06 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:07.583566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:07.598435 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-71f0719a-49b2-44ca-88af-0278f23685ed tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1500 microversion: 2.1 time: 0.410900 May 24 10:03:07.615366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 185/376] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:07 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1500 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:07.620885 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:07.645689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:07.661969 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:07.667139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:07.667139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:07.667139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:08.079707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:08.100045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c8a79401-01ca-46f3-8eaa-a6408437540d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1514 microversion: 2.1 time: 0.483404 May 24 10:03:08.100907 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 192/377] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:07 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1514 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:08.243758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:08.244382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:08.258946 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:08.263314 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:08.264447 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:08.265091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:08.679574 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:08.691194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:08.696920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:08.696920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b4714b29-2685-4949-8223-f29ad29bb874 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.455430 May 24 10:03:08.696920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 186/378] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:08 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:09.723013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:09.724384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:09.744229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:09.763359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:09.763359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:09.763359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:10.243028 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:10.261001 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:10.263845 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:10.265940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-40b23fff-f824-4e5a-9720-d641ccbc6788 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.546882 May 24 10:03:10.267327 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 193/379] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:09 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:11.007584 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:11.008641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:11.016396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.017135 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.030172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.030912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.103205 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lazy-loading 'flavor' on Instance uuid 5b161895-21f1-4c71-9f5f-4d521eaea323 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:03:11.285533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:11.286152 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:11.294464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.294921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.295709 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.296160 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.520728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:11.536096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:11.538003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:11.540730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-627f8647-4401-4729-822a-4d1d583536a6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.258863 May 24 10:03:11.560591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 194/380] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:11 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:03:11.643665 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a4715b47-5eab-4392-ade0-e79d828020d8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action" status: 200 len: 32 microversion: 2.1 time: 0.640206 May 24 10:03:11.644271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 187/381] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:03:11 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action => generated 32 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:03:11.653913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:11.654539 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:11.662180 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.662639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.663426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:11.663871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:11.871685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:11.880174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c199fd4b-59fe-41ce-b284-4a0ae1535541 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.230537 May 24 10:03:11.880854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 195/382] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:11 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:12.559315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:12.560084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:12.568666 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:12.569235 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:12.570114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:12.570582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:12.824236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:12.832990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:12.834528 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:12.835890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f84e63c5-2ec7-4a20-9999-7698eee989b0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.280799 May 24 10:03:12.836445 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 188/383] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:12 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:12.898303 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:12.898940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:12.906511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:12.906973 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:12.907766 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:12.908208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:13.141993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:13.161719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-fc70d2ff-01de-4fd2-8e73-ee8ab2ce7585 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.266984 May 24 10:03:13.163889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 196/384] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:12 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:13.854272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:13.855075 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:13.866112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:13.866568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:13.867368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:13.867816 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:14.080067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:14.090088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:14.091546 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:14.092688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-26e715d7-e205-43d3-a787-0b6ced215c80 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.242996 May 24 10:03:14.093283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 189/385] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:13 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:14.181526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:14.182131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:14.189888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:14.190355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:14.191163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:14.191612 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:14.431779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:14.440942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1977db18-03b3-41b4-a4af-91919f1052bc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.263861 May 24 10:03:14.441703 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 197/386] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:14 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:15.111488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:15.112118 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:15.120330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:15.120931 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:15.121859 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:15.122401 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:15.334650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:15.345956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:15.347845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:15.349260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4410e35a-e3d9-4b90-aadd-6630a1e74302 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.241729 May 24 10:03:15.349915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 190/387] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:15 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:15.459847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:15.460577 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:15.468957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:15.469449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:15.470249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:15.470695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:15.692837 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:15.702498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-47a6ac3f-ec74-43cf-91ab-a859aeddb123 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.247240 May 24 10:03:15.703089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 198/388] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:15 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:16.367291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:16.368094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:16.377573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:16.378309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:16.379280 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:16.379874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:16.588191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:16.598170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:16.599707 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:16.601037 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4037e408-9f50-4eef-8bc0-98950df307c1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.237553 May 24 10:03:16.601667 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 191/389] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:16 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:03:16.719780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:16.720388 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:16.729437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:16.731054 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:16.732050 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:16.732664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:16.941136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:16.951070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-836ff58f-9e2c-4e2d-9045-684c0de89582 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.235079 May 24 10:03:16.952269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 199/390] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:16 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:17.621518 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:17.622170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:17.629358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:17.638458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:17.638458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:17.638458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:17.841757 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:17.851205 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:17.853521 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:17.854741 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-958ae011-5091-428e-ab36-e5d093460609 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.238390 May 24 10:03:17.855305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 192/391] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:17 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:17.970569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:17.971115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:17.979168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:17.979610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:17.980409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:17.980855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:18.310843 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:18.320772 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a6c9beff-5991-4014-a465-c649d9e98207 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.353901 May 24 10:03:18.322110 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 200/392] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:17 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:18.873382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:18.874108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:18.884540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:18.885105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:18.885972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:18.886479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:19.090466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:19.099570 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:19.102009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:19.103492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-88ce2cf4-c866-4140-9231-050a5ea75581 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.235302 May 24 10:03:19.104138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 193/393] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:18 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:19.348343 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:19.348343 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:19.350524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:19.350982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:19.351783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:19.352226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:19.569397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:19.578267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e20b07fe-2a2e-4c5a-bb05-9680ad707ccc tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.241179 May 24 10:03:19.578902 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 201/394] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:19 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:20.122645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:20.123192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:20.130345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:20.130793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:20.133825 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:20.133825 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:20.394722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:20.404657 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:20.406214 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:20.407368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0da2abe5-b882-4313-acd0-74b6a2ec1157 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.289343 May 24 10:03:20.407928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 194/395] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:20 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:20.595975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:20.596636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:20.604646 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:20.605199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:20.605959 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:20.606398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:20.805322 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:20.813956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6380360c-1edd-4264-b0fd-ddc094a4346c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.221789 May 24 10:03:20.814524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 202/396] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:20 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:21.426371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:21.426917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:21.434737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:21.435195 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:21.435992 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:21.436438 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:21.649282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:21.658572 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:21.660092 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:21.661272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-04b6b740-abdf-4ee8-8a18-1924fa86a920 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.238808 May 24 10:03:21.666014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 195/397] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:21 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:21.834276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:21.834902 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:21.843367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:21.844041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:21.844834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:21.845297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:22.216111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:22.224584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5deb7f11-d78e-4071-b532-f4772f607724 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.394024 May 24 10:03:22.225298 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 203/398] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:21 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:22.679588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:22.680192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:22.688097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:22.688550 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:22.689363 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:22.689802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:22.900136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:22.910462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:22.911465 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:22.912637 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-39c30fd6-29e6-41ea-b311-0e97aca01ec4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.236777 May 24 10:03:22.913323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 196/399] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:22 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:23.241668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:23.242321 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:23.249894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:23.250341 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:23.251115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:23.252500 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:23.465330 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:23.473633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ebf6d474-fe9f-4631-8d8d-69769f77aeb9 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.235684 May 24 10:03:23.474195 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 204/400] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:23 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:23.931886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:23.932419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:23.939889 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:23.940315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:23.941127 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:23.941570 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:24.148171 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:24.158720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:24.160237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:24.161405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3387ac9a-eb04-439b-b9ab-f3d570ac71f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.234041 May 24 10:03:24.161956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 197/401] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:23 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:24.491042 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:24.491658 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:24.498944 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:24.499384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:24.500154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:24.500587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:24.706121 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:24.717541 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3cbe9873-e99f-4984-b54d-1dd2847c624b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.229830 May 24 10:03:24.720546 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 205/402] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:24 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:25.182515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:25.183109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:25.190442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:25.190895 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:25.191786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:25.192231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:25.395749 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:25.405200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:25.406772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:25.407974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a2330c67-a134-41c7-87c9-487e764b06d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.229792 May 24 10:03:25.408534 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 198/403] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:25 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:25.734960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:25.735575 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:25.743148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:25.743533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:25.744308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:25.744745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:25.960411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:25.969528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-258fa011-3dc9-43af-8c7a-cb651f8bb484 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.238230 May 24 10:03:25.972393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 206/404] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:25 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:26.427249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:26.427880 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:26.436061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:26.436594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:26.437437 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:26.437885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:26.642439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:26.651978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:26.653513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:26.654729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1e35be8b-d7f2-4fdd-b102-e3dcbc699988 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.231352 May 24 10:03:26.655309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 199/405] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:26 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:26.986437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:26.987146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:26.994501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:26.994962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:26.995744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:26.996187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:27.203852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:27.212405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-00ac585a-f758-48fc-b800-efa52dc6d522 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.229733 May 24 10:03:27.213481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 207/406] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:26 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:27.673252 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:27.673898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:27.681270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:27.682250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:27.683039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:27.683478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:27.900258 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:27.909845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:27.911549 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:27.912716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4fc6af24-eca5-4282-b163-08f35eee8dd7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.243310 May 24 10:03:27.913310 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 200/407] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:27 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:28.230887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:28.231679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:28.239627 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:28.240081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:28.241628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:28.241628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:28.449550 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:28.458058 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-77145a80-99ef-46ed-be77-819584728e40 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.232223 May 24 10:03:28.458603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 208/408] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:28 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:28.931380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:28.931890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:28.939141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:28.939618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:28.940379 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:28.940813 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:29.141454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:29.150848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:29.152805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:29.154155 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-301cf58a-5f5b-46a2-a0a5-e8502a40d41b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.226552 May 24 10:03:29.154937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 201/409] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:28 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:29.476401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:29.477101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:29.484965 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:29.485494 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:29.486284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:29.486726 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:29.687323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:29.695751 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e13b2f39-0fa0-471b-98df-fd0fa6ec13b0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.223171 May 24 10:03:29.696128 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 209/410] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:29 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:30.172502 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:30.173264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:30.180791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:30.181294 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:30.182094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:30.182535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:30.260384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-f49c9f52-b2a5-496f-ac4c-35f75f3617f0 req-48808173-ec4c-41b9-87c7-ce573e916b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "name": "network-vif-plugged", "status": "completed", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:30.262187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:03:30.262187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:03:30.275115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f49c9f52-b2a5-496f-ac4c-35f75f3617f0 req-48808173-ec4c-41b9-87c7-ce573e916b65 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:30.276420 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f49c9f52-b2a5-496f-ac4c-35f75f3617f0 req-48808173-ec4c-41b9-87c7-ce573e916b65 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:30.295737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-f49c9f52-b2a5-496f-ac4c-35f75f3617f0 req-48808173-ec4c-41b9-87c7-ce573e916b65 service nova] Creating event network-vif-plugged:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:03:30.301376 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-f49c9f52-b2a5-496f-ac4c-35f75f3617f0 req-48808173-ec4c-41b9-87c7-ce573e916b65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044647 May 24 10:03:30.302105 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 210/411] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:03:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:03:30.396608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:30.407363 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:30.408879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:30.410094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2f857616-0562-4f39-92e8-c24fe20c9ed8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.241304 May 24 10:03:30.410643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 202/412] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:30 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:30.714146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:30.714894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:30.722854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:30.723317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:30.724119 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:30.724568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:30.933294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:30.942064 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4a208510-fb50-4a7e-8e66-c05782bc5ee0 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.232398 May 24 10:03:30.942642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 211/413] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:30 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:31.428602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:31.429327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:31.436703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:31.437196 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:31.437985 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:31.438425 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:31.634527 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:31.644886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:31.646442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:31.647594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-090db1b6-b427-4d6c-a2d6-8d18ec4ab327 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.222892 May 24 10:03:31.648150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 203/414] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:31 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:31.960371 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:31.960983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:31.968217 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:31.968709 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:31.969554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:31.970026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:32.169611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:32.178043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-347942f9-0f0a-45d0-9067-b60a4a8b12cf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.221440 May 24 10:03:32.178598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 212/415] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:31 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:32.667295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:32.667915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:32.675706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:32.676162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:32.676970 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:32.677520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:32.888604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:32.903530 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:32.905277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:32.906712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-eb294feb-66b1-4b23-afc7-c46cb27f863d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.243495 May 24 10:03:32.907283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 204/416] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:32 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:33.195844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:33.199970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:33.204144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:33.204610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:33.205438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:33.205884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:33.410204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:33.418972 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-54f32628-8ec7-44b9-82e1-ad989e0f8976 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.228112 May 24 10:03:33.419528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 213/417] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:33 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:33.926581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:33.927559 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:33.937601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:33.938049 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:33.938830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:33.939309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:34.146281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:34.156938 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:34.158569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:34.159708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c9b31844-0b0b-4c99-bf7e-e513375e99d6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1809 microversion: 2.20 time: 0.238133 May 24 10:03:34.160265 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 205/418] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:33 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:03:34.435336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:34.436063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:34.443466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:34.443997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:34.444900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:34.445445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:34.668081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:34.677092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1ff37ed6-e260-4b20-a0a2-fe1e9d392d5b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.245430 May 24 10:03:34.677675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 214/419] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:34 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:34.680331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b3a54eb-2dad-46cf-8d5b-0aad8929f6b1", "device": "/dev/sdb"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:34.682454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:34.690083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:34.690541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:34.691366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:34.691838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:35.177960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:35.178574 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:35.186379 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:35.186829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:35.187602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:35.188038 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:35.393288 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:35.402970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:35.404407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:35.405583 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-64627887-c499-4552-a7e0-cf922fed9257 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1796 microversion: 2.20 time: 0.231376 May 24 10:03:35.406137 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 215/420] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:03:35 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1796 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:03:35.660460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1392c0a2-673a-404b-9f06-9a198f4a3cc0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "POST /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.984374 May 24 10:03:35.661256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 206/421] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:03:34 2021] POST /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:03:35.693363 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:35.694238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:35.701717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:35.702182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:35.702980 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:35.703429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:35.910434 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:35.920928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-420ac11f-4015-4194-b7ea-9812c3f34e9f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.231018 May 24 10:03:35.921330 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 216/422] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:35 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:36.940431 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:36.941462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:36.950590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:36.951043 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:36.951843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:36.952284 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:37.154015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:37.162866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c3809846-2dc7-4e7d-b344-08d52066613e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.227618 May 24 10:03:37.163439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 207/423] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:36 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:38.180913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:38.181636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:38.189795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.190264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.191055 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.191502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.397475 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:38.405770 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c51bb62f-04df-45f5-803b-f1d7fd1344ba tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1500 microversion: 2.1 time: 0.228730 May 24 10:03:38.408917 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 217/424] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:38 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:03:38.422892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2124a5-3bec-4e59-9a94-3d6abcc75e36"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:38.423999 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:38.431462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.431853 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.432647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.433596 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.490653 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] HTTP exception thrown: Cannot 'attach_volume' instance 5b161895-21f1-4c71-9f5f-4d521eaea323 while it is in vm_state rescued May 24 10:03:38.491253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Returning 409 to user: Cannot 'attach_volume' instance 5b161895-21f1-4c71-9f5f-4d521eaea323 while it is in vm_state rescued {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:03:38.492088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4c1dc5e1-f4a4-494b-88b6-266447d5bae4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073235 May 24 10:03:38.492663 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 208/425] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:03:38 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 10:03:38.501376 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:38.501924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:38.510295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.510762 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.512120 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.512564 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.835988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6fee4984-6459-416e-bea6-51243eeb0289 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action" status: 202 len: 0 microversion: 2.1 time: 0.338014 May 24 10:03:38.836619 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 218/426] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:03:38 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:03:38.845632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:38.846494 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:38.854501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.855498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:38.856588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:38.857036 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:39.065185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:39.074151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-79508e5d-9eeb-4c0f-aa4a-e3f62b9027ce tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1508 microversion: 2.1 time: 0.232812 May 24 10:03:39.074754 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 209/427] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:38 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:40.093113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:40.093911 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:40.101538 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:40.102047 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:40.102839 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:40.103284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:40.306231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:40.317495 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-fc4390d4-831e-4f24-a3be-769a8d8e7dfd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1508 microversion: 2.1 time: 0.229283 May 24 10:03:40.318240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 219/428] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:40 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:41.335496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:41.336106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:41.343867 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:41.344318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:41.345121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:41.345564 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:41.547961 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:41.556174 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1649b623-affa-43d2-a873-b66d0c999e03 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1508 microversion: 2.1 time: 0.224342 May 24 10:03:41.556725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 210/429] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:41 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:42.572908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:42.574088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:42.581712 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:42.582172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:42.582964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:42.583410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:42.785722 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:42.794873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4cd502de-47fd-4e78-b624-86af9d20c0ec tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1514 microversion: 2.1 time: 0.225637 May 24 10:03:42.795347 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 220/430] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:42 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:44.658103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:03:44.658723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:44.666437 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:44.667155 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:44.668456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:44.668896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:44.868860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:03:44.878008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-86a46934-cb8e-4238-8ca8-27a29c40a266 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1514 microversion: 2.1 time: 0.223583 May 24 10:03:44.878575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 211/431] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:03:44 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:03:44.894047 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0dfad7a-00bd-438a-940e-3ca36f42e755"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:03:44.895208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:03:44.903157 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:44.903615 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:44.904402 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:03:44.904843 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:03:45.705028 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3c9d976b-6f86-4157-acfa-13277f89dc56 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814657 May 24 10:03:45.705740 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 221/432] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:03:44 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:04:00.696776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:04:00.708836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:04:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:04:01.148176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:01.149085 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:01.158136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:01.158596 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:01.159405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:01.159845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:01.218740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lazy-loading 'flavor' on Instance uuid 5b161895-21f1-4c71-9f5f-4d521eaea323 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:01.661330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0cd2b378-2dc5-4157-865c-2687365f835f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action" status: 200 len: 32 microversion: 2.1 time: 0.515481 May 24 10:04:01.661330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 212/433] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:04:01 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:04:01.671071 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:01.671841 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:01.680173 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:01.680626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:01.681442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:01.681887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:02.113906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:02.123184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a6651884-4da3-4a22-845e-ffe0e2e4b44d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.457061 May 24 10:04:02.123760 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 222/434] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:01 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:03.139983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:03.140683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:03.148342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:03.148799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:03.149611 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:03.150095 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:03.349383 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:03.358242 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2fa09a82-5d32-4ef2-9982-8a53b5458cfa tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.222499 May 24 10:04:03.358806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 213/435] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:03 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:04.375663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:04.376280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:04.384043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:04.384490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:04.385304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:04.385741 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:04.582537 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:04.592052 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f343eab1-3220-4d89-bbd1-4f28a4259ba3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.220073 May 24 10:04:04.592548 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 223/436] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:04 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:05.610259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:05.611009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:05.621039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:05.621039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:05.621039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:05.621039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:05.830362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:05.840296 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b64aaaad-e8e4-40cd-ad80-2a6aa33d5fc3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.233624 May 24 10:04:05.840879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 214/437] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:05 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:06.533584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:06.534409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:06.542336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:06.542788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:06.543682 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:06.544257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:06.716894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lazy-loading 'services' on Instance uuid 61900f34-f721-4a3d-ad8c-ff38d86984fc {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:06.857317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:06.857933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:06.865927 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:06.866378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:06.867167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:06.867658 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:06.998971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-dad7db86-2f31-4f3f-a4f3-515c8515e7e0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc/os-volume_attachments/1b3a54eb-2dad-46cf-8d5b-0aad8929f6b1" status: 202 len: 0 microversion: 2.1 time: 0.469039 May 24 10:04:06.999783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 224/438] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:04:06 2021] DELETE /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc/os-volume_attachments/1b3a54eb-2dad-46cf-8d5b-0aad8929f6b1 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:04:07.145885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:07.155745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5b4392fc-192d-4a1b-9e19-46ed47b7d4b7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.302131 May 24 10:04:07.157189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 215/439] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:06 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:08.173080 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:08.173796 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:08.181272 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:08.181745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:08.183054 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:08.183508 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:08.388444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:08.397176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-db122c95-ecfe-409f-b8ee-1519b249d6ef tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.228284 May 24 10:04:08.397733 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 225/440] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:08 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:09.414400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:09.414995 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:09.423306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:09.424063 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:09.425328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:09.425794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:09.627259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:09.636055 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-95bfdcd1-2df3-4ee6-9614-c2fc4a6e8188 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.225523 May 24 10:04:09.639038 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 216/441] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:09 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:10.652912 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:10.653493 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:10.660870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:10.661346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:10.662122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:10.662555 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:10.862300 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:10.871838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f0ed81c8-2b8f-43cd-b715-b39e1d9a8c32 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.222729 May 24 10:04:10.872406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 226/442] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:10 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:11.888512 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:11.889161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:11.896475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:11.896928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:11.897745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:11.898190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.094635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:12.104361 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2862e21c-70ad-4f1e-876d-2b9050ebcb04 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.219385 May 24 10:04:12.105655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 217/443] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:11 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:12.592592 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:12.593230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:12.600622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.601148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.601940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.602389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.664079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:04:12.851956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:12.852384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:12.860496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.860946 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.861748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.862184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.963433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-27a99b13-8b64-4f9b-96e1-6a4d81d402e7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 204 len: 0 microversion: 2.1 time: 0.374238 May 24 10:04:12.964640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 227/444] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:04:12 2021] DELETE /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:04:12.972972 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:12.975660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:12.981456 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.981896 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:12.982692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:12.983124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:13.032141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lazy-loading 'services' on Instance uuid b5b44b45-4a2f-48d5-851a-222d48691c7e {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:13.193012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:13.201961 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e0d9141f-b65b-4bf0-bb7f-f73325b9ea8d tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1514 microversion: 2.1 time: 0.232901 May 24 10:04:13.202545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 228/445] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:12 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:13.211689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:13.211689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:13.215665 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:13.216192 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:13.217091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:13.217606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:13.359271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-015f59ea-65ba-4718-8401-98304ae01df6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-volume_attachments/cf9bba16-8ded-4143-9df7-cf66ebdab579" status: 202 len: 0 microversion: 2.1 time: 0.510998 May 24 10:04:13.359908 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 218/446] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:04:12 2021] DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/os-volume_attachments/cf9bba16-8ded-4143-9df7-cf66ebdab579 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:04:13.422267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:13.431294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-339d9e61-e6a9-4116-8a7c-3d74a0164828 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.227759 May 24 10:04:13.431946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 229/447] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:13 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:14.220785 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:14.221566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:14.228912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:14.230182 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:14.230906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:14.231352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:14.433510 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:14.442566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c48b56fd-d1ac-4557-a529-87622223b1bd tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1514 microversion: 2.1 time: 0.226196 May 24 10:04:14.443075 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 219/448] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:14 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:14.448791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:14.449443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:14.456582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:14.457072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:14.457939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:14.458454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:14.667683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:14.679142 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4e150ba7-aaa9-48b5-9f2a-200395459e34 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.234087 May 24 10:04:14.688182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 230/449] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:14 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:15.458519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:15.459144 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:15.466837 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.467294 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.469975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.469975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.665377 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-863dca84-e066-4750-9f71-f711de2c29be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:15.674125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-863dca84-e066-4750-9f71-f711de2c29be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.674579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-863dca84-e066-4750-9f71-f711de2c29be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.683205 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:15.691924 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-32d2a38a-2bd0-4f36-b6ed-ec5e34ae1214 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1514 microversion: 2.1 time: 0.237036 May 24 10:04:15.701439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 220/450] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:15 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:15.704084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:15.704873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:15.712986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.714538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.715373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.715928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.736015 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-863dca84-e066-4750-9f71-f711de2c29be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Going to try to stop instance {{(pid=123673) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 24 10:04:15.923937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:15.932139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-863dca84-e066-4750-9f71-f711de2c29be tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.270375 May 24 10:04:15.933114 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bbb34a5a-60fb-4b6d-90c2-ba8cac130459 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.233313 May 24 10:04:15.933391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 231/451] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:04:15 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:04:15.934139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 221/452] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:15 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:15.948496 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:15.949251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:15.956675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.969041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:15.969041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:15.969041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.204000 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-3ad983b0-ac92-40e4-aabe-a7290ef64046 req-4662dd94-2485-4a4b-9a06-c61bf2834672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61900f34-f721-4a3d-ad8c-ff38d86984fc", "name": "network-vif-deleted", "tag": "855e6647-516e-462d-8d07-0f5cf828da14"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:16.205603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:04:16.205603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:04:16.214488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-3ad983b0-ac92-40e4-aabe-a7290ef64046 req-4662dd94-2485-4a4b-9a06-c61bf2834672 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.220743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-3ad983b0-ac92-40e4-aabe-a7290ef64046 req-4662dd94-2485-4a4b-9a06-c61bf2834672 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.240958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-3ad983b0-ac92-40e4-aabe-a7290ef64046 req-4662dd94-2485-4a4b-9a06-c61bf2834672 service nova] Creating event network-vif-deleted:855e6647-516e-462d-8d07-0f5cf828da14 for instance 61900f34-f721-4a3d-ad8c-ff38d86984fc on hv-cinder-79123 May 24 10:04:16.254356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-3ad983b0-ac92-40e4-aabe-a7290ef64046 req-4662dd94-2485-4a4b-9a06-c61bf2834672 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053909 May 24 10:04:16.255320 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 222/453] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:04:16.293436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:16.301723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-51ce65f9-0248-4e87-9a52-531e5e421b68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.357405 May 24 10:04:16.303458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 232/454] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:15 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:16.709861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:16.710569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:16.718537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.718991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.719772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.720213 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.787976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.788425 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.788875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lazy-loading 'fault' on Instance uuid 61900f34-f721-4a3d-ad8c-ff38d86984fc {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:16.847379 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:16.855648 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-59181f4e-bd3f-47ec-a4ec-70b351bb9111 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 200 len: 1309 microversion: 2.1 time: 0.150152 May 24 10:04:16.860975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 223/455] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:16 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:16.950694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:16.951307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:16.960288 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.960671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:16.961471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:16.961910 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:17.166752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:17.175785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f6e4bc6b-c8fd-4701-924a-84b901d2ec00 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.229604 May 24 10:04:17.176348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 233/456] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:16 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:17.325065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:17.325714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:17.333588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:17.334051 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:17.334833 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:17.335315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:17.537367 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:17.546224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f318212e-9c43-41de-a0a9-5e4a0ecc02eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.225529 May 24 10:04:17.546790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 224/457] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:17 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:17.877883 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:17.878503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 61900f34-f721-4a3d-ad8c-ff38d86984fc] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:17.886826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:17.887219 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:17.888018 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:17.888481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:17.942335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] HTTP exception thrown: Instance 61900f34-f721-4a3d-ad8c-ff38d86984fc could not be found. May 24 10:04:17.943029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Returning 404 to user: Instance 61900f34-f721-4a3d-ad8c-ff38d86984fc could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:04:17.943976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f4c8ed06-f35d-4802-9385-f2f686c15ecb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc" status: 404 len: 111 microversion: 2.1 time: 0.069642 May 24 10:04:17.944524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 234/458] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:17 2021] GET /compute/v2.1/servers/61900f34-f721-4a3d-ad8c-ff38d86984fc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:04:18.192995 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:18.201182 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:18.201772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:18.202235 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:18.203065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:18.203548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:18.572670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:18.572670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4196ace8-dd61-44da-b929-ce1393f1415f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.370779 May 24 10:04:18.572670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 225/459] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:18 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:18.573810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:18.573810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:18.573810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:18.573810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:18.574503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:18.574503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:18.781248 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:18.790772 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-266749e1-7be8-418d-99c6-d6048f76d269 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.229546 May 24 10:04:18.790772 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 235/460] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:18 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:19.577371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:19.577891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:19.585289 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:19.585832 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:19.586635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:19.587088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:19.789728 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:19.799029 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-64084f68-df6a-4659-8b5a-a2587f193c42 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.225830 May 24 10:04:19.799594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 226/461] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:19 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:19.807574 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:19.808218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:19.815529 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:19.815978 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:19.816764 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:19.817239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:20.016685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:20.025240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6296ee6f-0e44-4a6b-9002-1ea05b29073d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.221358 May 24 10:04:20.025814 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 236/462] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:19 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:20.815860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:20.816479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:20.824266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:20.824723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:20.825533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:20.825973 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:21.029260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:21.038204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-70dcce10-7a6d-41ec-b2bd-2e26663ec868 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.226208 May 24 10:04:21.039189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 227/463] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:20 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:21.043582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:21.044730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:21.052099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:21.052581 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:21.053388 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:21.053845 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:21.257611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:21.265968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-83294e69-9134-4ad2-8145-a769e4c813bd tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.226591 May 24 10:04:21.266535 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 237/464] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:21 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:22.056299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:22.057065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:22.069330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:22.069330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:22.069330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:22.069330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:22.269079 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:22.279013 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5d9d2f28-d58c-45ef-b191-07d988438dc4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.226827 May 24 10:04:22.279576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 228/465] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:22 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:22.283632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:22.292544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:22.292682 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:22.293074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:22.293864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:22.294304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:22.497350 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:22.505498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b6988873-66ee-4d35-b181-06c5afe03a0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.225760 May 24 10:04:22.506096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 238/466] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:22 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:23.296629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:23.297256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:23.304819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:23.305387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:23.306098 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:23.306536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:23.503764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:23.513515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6fc516a0-e2ea-4010-85f8-93156dbbf82f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.221085 May 24 10:04:23.514193 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 229/467] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:23 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:23.522918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:23.523550 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:23.531524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:23.531982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:23.532988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:23.533678 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:23.743419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:23.751776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5a462860-2b6c-4207-a864-27d0a2be3e61 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.232547 May 24 10:04:23.752361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 239/468] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:23 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:24.529446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:24.530090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:24.537746 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:24.538192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:24.538972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:24.539407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:24.743607 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:24.752782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d0b20e2b-0eb9-409b-9573-54d9c0d63c86 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.227098 May 24 10:04:24.753420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 230/469] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:24 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:24.769329 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:24.769947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:24.777776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:24.778224 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:24.778996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:24.779433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:24.974619 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:24.983897 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-92f2b4f0-9a4d-4fe9-b70f-fc5c5d7ace5f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.218406 May 24 10:04:24.984455 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 240/470] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:24 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:25.780345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:25.780345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:25.787469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:25.787860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:25.788628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:25.789084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:25.981443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:25.990090 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d8b2d7c8-c42a-45db-b91f-97082a75ee9d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.214714 May 24 10:04:25.990653 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 231/471] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:25 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:26.000601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:26.001254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:26.008420 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:26.008870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:26.009673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:26.010111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:26.204828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:26.213336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-701b2bee-85fc-4913-ab1c-bca2a79b59e8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.216302 May 24 10:04:26.213914 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 241/472] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:25 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:27.007756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:27.008376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:27.015622 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:27.016067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:27.016846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:27.017321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:27.213190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:27.222409 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3923d0e0-5cf9-4b98-9933-e39ab995ecdf tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.218817 May 24 10:04:27.222978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 232/473] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:27 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:27.230768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:27.231382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:27.238683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:27.239138 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:27.239919 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:27.240370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:27.434082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:27.442327 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-01de659a-43ac-44f0-9234-93935d6c842c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.215888 May 24 10:04:27.442895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 242/474] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:27 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:28.239659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:28.240301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:28.248657 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:28.249138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:28.249917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:28.250351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:28.447850 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:28.457779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a95400ad-e2a4-4e0a-aee4-1ede6dd556c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.221869 May 24 10:04:28.459498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 233/475] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:28 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:28.459619 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:28.460244 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:28.468060 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:28.468516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:28.469353 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:28.469797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:28.670331 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:28.678571 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-347d1f41-463f-4e83-a3f9-0b9869faa2e9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.222808 May 24 10:04:28.679124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 243/476] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:28 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:29.474784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:29.475420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:29.483829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:29.484275 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:29.485069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:29.485503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:29.688001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:29.696657 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c60be791-e099-4630-a901-7b8a615e674d tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.225490 May 24 10:04:29.697243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 234/477] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:29 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:29.700125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:29.700833 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:29.708192 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:29.708647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:29.709471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:29.709918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:29.903025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:29.911170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-00a965cb-ccb0-49a3-a100-3c4c91de8352 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.214821 May 24 10:04:29.911736 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 244/478] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:29 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:30.714083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:30.714616 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:30.722424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:30.722998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:30.723792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:30.724284 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:30.917908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-662333955", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "2852c3dc-6508-45a7-9576-a36787475d18"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:30.975632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:30.984788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] validate_networks() for [('2852c3dc-6508-45a7-9576-a36787475d18', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:04:30.984951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-46b1d06e-f8b7-4f3a-8b31-831de44241d3 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.275115 May 24 10:04:30.985556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 235/479] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:30 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:30.989946 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:30.990667 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:30.998852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:30.999302 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:31.000098 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:31.000541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:31.202846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:31.214053 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5fd9db63-ecda-4417-bb27-4ccdd25a3ca9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.227493 May 24 10:04:31.214827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 236/480] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:30 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:31.642487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:04:31.642971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:04:31.643461 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:04:31.643879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:04:31.644298 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:04:31.652812 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:31.653307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:31.654622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:31.655062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:31.672874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Getting quotas for project 0fa87500244642ee805dba47191bc7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:04:31.676975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Getting quotas for user 87c525da11c94e1bb14cf55dda4c3cae and project 0fa87500244642ee805dba47191bc7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:04:31.687575 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:04:31.689927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:04:31.788125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d70999f1-ded7-4e91-b157-8981ee5b592a tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874108 May 24 10:04:31.788723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 245/481] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:04:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:04:31.798968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9c17a130-bb95-47b0-8f13-bfc04f480c1e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:31.799583 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9c17a130-bb95-47b0-8f13-bfc04f480c1e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:31.870008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9c17a130-bb95-47b0-8f13-bfc04f480c1e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:31.877379 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9c17a130-bb95-47b0-8f13-bfc04f480c1e tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1218 microversion: 2.1 time: 0.082305 May 24 10:04:31.877949 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 237/482] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:31 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:32.002203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:32.003109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:32.010635 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.011085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:32.011856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.012374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:32.214927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:32.223750 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bf953093-e35d-49b7-b7f0-4abb35795d51 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.225434 May 24 10:04:32.224318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 246/483] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:31 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:32.231277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:32.239061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:32.239950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.240414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:32.241249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.241695 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:32.444710 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:32.452899 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-115b6e7d-cdcc-4573-ac17-a8bc55db24c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.225363 May 24 10:04:32.453487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 238/484] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:32 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:32.893678 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:32.894275 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:32.901547 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.901999 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:32.902775 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:32.903212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:33.016171 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:33.024885 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e4750153-e26f-4d02-a85e-91a1f076b0d5 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1222 microversion: 2.1 time: 0.134855 May 24 10:04:33.025483 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 247/485] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:32 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:33.239977 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:33.240599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:33.248271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:33.248807 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:33.249560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:33.250002 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:33.463643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:33.471133 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:33.471752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:33.474543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-661e4202-2133-4e0f-ae9f-16d866cc366b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1566 microversion: 2.1 time: 0.238233 May 24 10:04:33.475359 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 239/486] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:33 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:33.484454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:33.484454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:33.484454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:33.484454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:33.690393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:33.699286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-70f32201-6508-444c-aaac-f0a49043b762 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1676 microversion: 2.1 time: 0.232645 May 24 10:04:33.699863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 248/487] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:33 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:34.042273 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:34.042916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:34.053592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.054040 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.060777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.060777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.171427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:34.179711 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e686c010-4af3-41df-b870-c03d7ce245f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1270 microversion: 2.1 time: 0.141398 May 24 10:04:34.180282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 240/488] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:34 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:34.491914 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:34.492537 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:34.499999 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.500457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.501365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.501800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.706238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:34.715279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6be00f5a-4bbf-4545-bfa1-b6535ebda617 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1546 microversion: 2.1 time: 0.227041 May 24 10:04:34.715853 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 249/489] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:34 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:34.717632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:34.723038 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:34.725642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.726220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.726917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.727357 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.732441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:34.733011 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:34.740328 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.740783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.741596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.742037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.910801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] HTTP exception thrown: Cannot 'detach_volume' instance 5b161895-21f1-4c71-9f5f-4d521eaea323 while it is in vm_state rescued May 24 10:04:34.911405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Returning 409 to user: Cannot 'detach_volume' instance 5b161895-21f1-4c71-9f5f-4d521eaea323 while it is in vm_state rescued {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:04:34.912343 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9deba144-3ef3-4db2-9fd6-8c9821515e3b tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments/c0dfad7a-00bd-438a-940e-3ca36f42e755" status: 409 len: 152 microversion: 2.1 time: 0.183995 May 24 10:04:34.913024 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 250/490] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:04:34 2021] DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments/c0dfad7a-00bd-438a-940e-3ca36f42e755 => generated 152 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 24 10:04:34.921905 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:34.922418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:34.930492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.930951 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.931144 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:34.931740 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.932188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:34.939940 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-39541b47-ce33-457b-b705-88e3d9669a91 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1653 microversion: 2.1 time: 0.226545 May 24 10:04:34.940529 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 241/491] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:34 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1653 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:34.956842 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a2008800-c33b-45af-8032-9adb8649fe40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:34.968122 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2008800-c33b-45af-8032-9adb8649fe40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:34.968122 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a2008800-c33b-45af-8032-9adb8649fe40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.024679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a2008800-c33b-45af-8032-9adb8649fe40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Going to try to start instance {{(pid=123672) start /opt/stack/nova/nova/compute/api.py:2602}} May 24 10:04:35.212793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1dca1a2e-1a9e-4b79-8d11-ccf136c38425 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action" status: 202 len: 0 microversion: 2.1 time: 0.294394 May 24 10:04:35.213421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 251/492] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:04:34 2021] POST /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:04:35.218490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:35.219193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:35.226927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.227380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.228174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.228611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.241333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a2008800-c33b-45af-8032-9adb8649fe40 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.287811 May 24 10:04:35.242231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 242/493] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:04:34 2021] POST /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:04:35.247427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:35.248851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:35.256761 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.257247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.258031 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.258623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.343669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:35.351984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5a6367be-39a0-4686-9d26-bc3c1e4389ad tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1278 microversion: 2.1 time: 0.137423 May 24 10:04:35.352546 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 252/494] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:35 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:35.356829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:35.357460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:35.364571 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.365026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.365838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:35.366284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:35.459894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:35.471567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ade9777b-5c54-4e66-82b8-a76606536129 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1554 microversion: 2.1 time: 0.225924 May 24 10:04:35.471567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 243/495] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:35 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:35.568269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:35.576674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1c2f8264-f3dc-453a-848a-63e031256069 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1662 microversion: 2.1 time: 0.223131 May 24 10:04:35.580127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 253/496] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:35 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1662 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:36.368994 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:36.369689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:36.377032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.377498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.378285 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.378734 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.486990 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:36.487610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:36.494966 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.495429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.495695 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:36.496226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.496675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.503835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c9ddf618-b56d-4b66-bc5a-f71be3aee8f0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1278 microversion: 2.1 time: 0.138542 May 24 10:04:36.504396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 244/497] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:36 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:36.593929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:36.594549 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:36.601873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.602332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.603118 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:36.603563 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:36.697117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:36.706611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0a26dedd-6245-4f7b-af9e-3d8fa0d454c7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1554 microversion: 2.1 time: 0.223375 May 24 10:04:36.707176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 254/498] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:36 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:36.801647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:36.811810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1d3e8aec-65b6-42c3-aacb-095f4daa6d29 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1662 microversion: 2.1 time: 0.221639 May 24 10:04:36.812385 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 245/499] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:36 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1662 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:37.520121 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:37.520935 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:37.528903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.530068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:37.530912 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.531372 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:37.679282 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:37.690746 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e9836783-6871-4fc5-97c1-bae6202b5bf2 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1288 microversion: 2.1 time: 0.174256 May 24 10:04:37.705430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 255/500] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:37 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:37.723766 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:37.724450 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:37.732167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.732665 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:37.733501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.733953 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:37.837193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:37.838269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:37.851530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.852366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:37.853580 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:37.854228 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:38.352043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:38.360844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:38.367190 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8e5deca4-910c-4b0c-abb5-836281945ef0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1662 microversion: 2.1 time: 0.540747 May 24 10:04:38.368243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 256/501] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:37 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1662 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:38.378212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a8286d3f-4720-4e52-87da-78fb1632cde8 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1554 microversion: 2.1 time: 0.658241 May 24 10:04:38.379108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 246/502] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:37 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1554 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:38.707722 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:38.708970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:38.722243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:38.722996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:38.726593 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:38.727277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:39.151563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:39.160939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6d70e721-70b8-4830-a0ac-338bd68812b7 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.456877 May 24 10:04:39.161591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 257/503] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:38 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:39.385861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:39.386580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:39.396165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:39.396409 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:39.397035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:39.397715 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:39.398113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:39.398751 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:39.406070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:39.406530 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:39.407332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:39.407793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:39.623975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:39.633272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8ec0b72c-4944-44b9-8af1-af43aeba90c9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1662 microversion: 2.1 time: 0.251597 May 24 10:04:39.633859 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 247/504] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:39 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1662 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:39.674000 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:39.682874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d3341e0a-bdbb-4069-b9f2-f235a9db237a tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1554 microversion: 2.1 time: 0.291061 May 24 10:04:39.683432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 258/505] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:39 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:40.178909 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:40.179531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:40.187684 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.188144 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.188948 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.189415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.243908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-5447fd5d-f1d9-41c5-b237-1d4c7defa3e0 req-0721cca0-2f96-4225-bce6-59568d342488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8315e706-66b1-49e6-a581-061abaf6c6db", "tag": "086b9a1c-9348-4b08-b6f7-f934b5e8aaa4"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:40.246296 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:04:40.246296 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:04:40.262302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-5447fd5d-f1d9-41c5-b237-1d4c7defa3e0 req-0721cca0-2f96-4225-bce6-59568d342488 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.262302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-5447fd5d-f1d9-41c5-b237-1d4c7defa3e0 req-0721cca0-2f96-4225-bce6-59568d342488 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.273407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-5447fd5d-f1d9-41c5-b237-1d4c7defa3e0 req-0721cca0-2f96-4225-bce6-59568d342488 service nova] Creating event network-changed:086b9a1c-9348-4b08-b6f7-f934b5e8aaa4 for instance 8315e706-66b1-49e6-a581-061abaf6c6db on hv-cinder-79123 May 24 10:04:40.278386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-5447fd5d-f1d9-41c5-b237-1d4c7defa3e0 req-0721cca0-2f96-4225-bce6-59568d342488 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043857 May 24 10:04:40.279002 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 259/506] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:04:40.422305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:40.438036 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4be1ae3b-8920-4790-9938-a0e0067778ef tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.262820 May 24 10:04:40.442968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 248/507] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:40 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:40.652591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:40.653262 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:40.662554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.663223 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.666795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.666795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.700075 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:40.700884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:40.709765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.710220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.711185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:40.711625 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:40.922236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:40.931479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-35120663-07d2-47b1-a6d7-44b6fe9f50d7 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1560 microversion: 2.1 time: 0.235238 May 24 10:04:40.932046 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 249/508] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:40 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:40.992131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:41.003101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c7c35633-617a-4298-a4da-156127935e58 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1666 microversion: 2.1 time: 0.355131 May 24 10:04:41.012611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 260/509] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:40 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1666 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:41.049392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:41.049917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:41.057337 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:41.057792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:41.058573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:41.059012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:41.225330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lazy-loading 'services' on Instance uuid 5b161895-21f1-4c71-9f5f-4d521eaea323 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:41.455198 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:41.455786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:41.463664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:41.464113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:41.464968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:41.465432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:41.535024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-be4df80e-9e95-4368-b1a5-4e590fe45db4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments/c0dfad7a-00bd-438a-940e-3ca36f42e755" status: 202 len: 0 microversion: 2.1 time: 0.489810 May 24 10:04:41.535737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 250/510] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:04:41 2021] DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323/os-volume_attachments/c0dfad7a-00bd-438a-940e-3ca36f42e755 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:04:41.689270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:41.697686 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e1f195ea-f58c-4ce0-a69d-f023c4af0aa3 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.247092 May 24 10:04:41.698208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 261/511] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:41 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:42.715738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:42.716566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:42.725460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:42.725918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:42.726704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:42.727136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:42.976456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:42.986290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-585dbb9b-6232-42f2-af3e-1ea2ab392e25 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.275108 May 24 10:04:42.986855 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 251/512] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:42 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:43.282370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:43.282950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:43.290342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:43.290790 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:43.291929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:43.292380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:43.358239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-39b6cc14-ccb2-4197-9f69-0659e8af107f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments/041337cb-949d-4467-a0fd-19278fbc3e6e" status: 200 len: 194 microversion: 2.20 time: 0.079634 May 24 10:04:43.358864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 262/513] 10.222.0.67 () {60 vars in 1454 bytes} [Mon May 24 10:04:43 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments/041337cb-949d-4467-a0fd-19278fbc3e6e => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:04:43.587475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:43.588049 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:43.596019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:43.596477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:43.597318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:43.597765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:43.890203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lazy-loading 'services' on Instance uuid 02d59782-db8b-4885-a4ec-a57499c07fe1 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:44.002902 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:44.003525 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:44.010963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:44.011417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:44.012204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:44.012640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:44.168115 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-464a8bad-7c2a-4207-8772-06efa7313e4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments/041337cb-949d-4467-a0fd-19278fbc3e6e" status: 202 len: 0 microversion: 2.20 time: 0.584176 May 24 10:04:44.171918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 252/514] 10.222.0.67 () {60 vars in 1457 bytes} [Mon May 24 10:04:43 2021] DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1/os-volume_attachments/041337cb-949d-4467-a0fd-19278fbc3e6e => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:04:44.221554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:44.230401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1299421f-c08b-437e-8fe4-d6bfc5572086 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.231072 May 24 10:04:44.233794 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 263/515] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:43 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:45.247824 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:45.249081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:45.256566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.257022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.257861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.258303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.380195 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:45.381455 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:45.390690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.391148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.391957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.392586 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.459318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:04:45.549349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:45.558795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d0572a15-dac6-4b70-b859-c2295656a9d1 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.315113 May 24 10:04:45.559533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 253/516] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:45 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:45.565515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:45.565515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:45.573033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.573672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.574496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.574932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.643454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:04:45.957780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0e4d8098-4250-4dc1-83e8-e4aed6016267 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 204 len: 0 microversion: 2.20 time: 0.581127 May 24 10:04:45.958608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 264/517] 10.222.0.67 () {60 vars in 1280 bytes} [Mon May 24 10:04:45 2021] DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 24 10:04:45.969500 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:45.970453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:45.977876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.983277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:45.983277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:45.983277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.020417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e77cecd2-a366-4044-a748-7faaa37830a4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 204 len: 0 microversion: 2.1 time: 0.459613 May 24 10:04:46.021091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 254/518] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:04:45 2021] DELETE /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:04:46.034156 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:46.036348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:46.046088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:46.046519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.047261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:46.047708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.195410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:46.205823 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:46.207426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:46.208665 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-67244f43-10bb-44a3-8bcb-83139af11e75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.245383 May 24 10:04:46.209245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 265/519] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:45 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:04:46.257929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:46.266968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-78ec617a-84b2-49f4-96d6-c290d30d555f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1506 microversion: 2.1 time: 0.240898 May 24 10:04:46.267617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 255/520] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:46 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:46.581796 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:46.583160 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:46.592113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:46.592589 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.593910 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:46.594393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.746952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-90d2cbc9-d430-4d52-a290-ff3f6bb7ce67 req-fc50903b-eafc-4cd3-a4bf-7d6f07ce46f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8315e706-66b1-49e6-a581-061abaf6c6db", "name": "network-vif-plugged", "status": "completed", "tag": "086b9a1c-9348-4b08-b6f7-f934b5e8aaa4"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:46.749463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:04:46.749463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:04:46.758187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-90d2cbc9-d430-4d52-a290-ff3f6bb7ce67 req-fc50903b-eafc-4cd3-a4bf-7d6f07ce46f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:46.758809 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-90d2cbc9-d430-4d52-a290-ff3f6bb7ce67 req-fc50903b-eafc-4cd3-a4bf-7d6f07ce46f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:46.788391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-90d2cbc9-d430-4d52-a290-ff3f6bb7ce67 req-fc50903b-eafc-4cd3-a4bf-7d6f07ce46f8 service nova] Creating event network-vif-plugged:086b9a1c-9348-4b08-b6f7-f934b5e8aaa4 for instance 8315e706-66b1-49e6-a581-061abaf6c6db on hv-cinder-79123 May 24 10:04:46.793580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-90d2cbc9-d430-4d52-a290-ff3f6bb7ce67 req-fc50903b-eafc-4cd3-a4bf-7d6f07ce46f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050225 May 24 10:04:46.794532 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 256/521] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:04:46.813511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:46.824661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-947744e4-9e11-42a6-a299-293e4a928e06 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.249608 May 24 10:04:46.825342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 266/522] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:46 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:47.228321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:47.229032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:47.239308 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.239806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:47.240573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.241032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:47.284345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:47.285177 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:47.293010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.298281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:47.298281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.298281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:47.494637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:47.498603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:47.503801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9b805194-1c4a-4317-abd1-345a7126b8d6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1506 microversion: 2.1 time: 0.223191 May 24 10:04:47.505132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 267/523] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:47 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:47.508566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:47.510488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:47.511829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c769a8b2-38d9-45d1-8591-241f8ae4b043 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.287750 May 24 10:04:47.521442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 257/524] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:47 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:04:47.840917 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:47.841559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:47.848752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.849256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:47.850050 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:47.850498 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:48.344417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:48.353660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-61984477-d434-44f9-82ba-e276c3d8fff0 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1318 microversion: 2.1 time: 0.516491 May 24 10:04:48.364056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 268/525] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:47 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:48.521465 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:48.522097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:48.530404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:48.531081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:48.532467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:48.533764 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:48.534440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:48.534527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:48.541944 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:48.542398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:48.543182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:48.544075 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:48.755681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:48.764194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-70538099-2071-47b8-bfbb-8a7f0ba3bbee tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1506 microversion: 2.1 time: 0.246387 May 24 10:04:48.764805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 258/526] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:48 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:49.127757 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:49.137005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:49.139374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:49.140612 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3a98fe3e-6c95-4d06-b625-43eba6c93dd9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1724 microversion: 2.20 time: 0.611949 May 24 10:04:49.141317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 269/527] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:48 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1724 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:04:49.371825 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:49.372764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:49.380418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.381143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:49.382106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.382713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:49.690715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:49.703255 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ca044139-2057-4247-afde-67df86e8fd89 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1506 microversion: 2.1 time: 0.335168 May 24 10:04:49.707294 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 259/528] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:49 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:49.724204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4200db51-8c7f-4d8a-9d43-a799cdafe496", "device": "/dev/sdb"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:49.725916 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:49.733787 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.734451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:49.735403 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.736024 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:49.782464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:49.784561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:49.813429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.814146 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:49.815246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:49.815844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:50.312264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:50.320632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7b7366e5-41b8-45e2-b1d8-2457400448d1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1464 microversion: 2.1 time: 0.542814 May 24 10:04:50.334423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 260/529] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:49 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1464 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:50.346982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-959fab93-3165-408e-904d-750fc538c95a req-83ac3bec-22ff-4646-a973-b6436de48329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e740327b-669e-49e2-9b7c-1f72d272e5e4", "name": "network-vif-deleted", "tag": "c7f85b81-de77-4ee2-8223-a1fb751791f5"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:50.353287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:04:50.353287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:04:50.376089 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-959fab93-3165-408e-904d-750fc538c95a req-83ac3bec-22ff-4646-a973-b6436de48329 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:50.376555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-959fab93-3165-408e-904d-750fc538c95a req-83ac3bec-22ff-4646-a973-b6436de48329 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:50.412413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-959fab93-3165-408e-904d-750fc538c95a req-83ac3bec-22ff-4646-a973-b6436de48329 service nova] Creating event network-vif-deleted:c7f85b81-de77-4ee2-8223-a1fb751791f5 for instance e740327b-669e-49e2-9b7c-1f72d272e5e4 on hv-cinder-79123 May 24 10:04:50.423569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-959fab93-3165-408e-904d-750fc538c95a req-83ac3bec-22ff-4646-a973-b6436de48329 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084047 May 24 10:04:50.424802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 261/530] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:04:50.432791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:50.433793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:50.442271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:50.443016 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:50.444002 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:50.444633 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:50.585608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:50.597519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:50.601352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:50.603959 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7becbb7a-76e6-48f0-8280-c222b40333bb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1656 microversion: 2.20 time: 0.175814 May 24 10:04:50.608783 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 262/531] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:50 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1656 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:04:50.613573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-08a9b861-06c7-4a01-b487-7074e2b2c8f1 req-0ef38c48-6557-45eb-9b1f-88a5048d4708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d59782-db8b-4885-a4ec-a57499c07fe1", "name": "network-vif-deleted", "tag": "6fec3696-3d1d-4762-9674-fe87fd37e211"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:50.616305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:04:50.616305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:04:50.659556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-08a9b861-06c7-4a01-b487-7074e2b2c8f1 req-0ef38c48-6557-45eb-9b1f-88a5048d4708 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:50.660417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-08a9b861-06c7-4a01-b487-7074e2b2c8f1 req-0ef38c48-6557-45eb-9b1f-88a5048d4708 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:50.726753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-08a9b861-06c7-4a01-b487-7074e2b2c8f1 req-0ef38c48-6557-45eb-9b1f-88a5048d4708 service nova] Creating event network-vif-deleted:6fec3696-3d1d-4762-9674-fe87fd37e211 for instance 02d59782-db8b-4885-a4ec-a57499c07fe1 on hv-cinder-79123 May 24 10:04:50.758012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-08a9b861-06c7-4a01-b487-7074e2b2c8f1 req-0ef38c48-6557-45eb-9b1f-88a5048d4708 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147759 May 24 10:04:50.761306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 263/532] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:04:50.996678 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-78d1b956-21dd-46fd-9957-9c1d0b490a1c tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "POST /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.275798 May 24 10:04:50.997091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 270/533] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:04:49 2021] POST /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db/os-volume_attachments => generated 194 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:04:51.339464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:51.340407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:51.350978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.357490 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.358520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.360561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.514929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.515454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.528243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lazy-loading 'fault' on Instance uuid e740327b-669e-49e2-9b7c-1f72d272e5e4 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:51.630300 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:51.631072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:51.647481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.650098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.650098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.650098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.657177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:51.671676 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5869bd25-0825-45d3-947f-a30b4e27e7c6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 200 len: 1311 microversion: 2.1 time: 0.335701 May 24 10:04:51.673453 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 264/534] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:51 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:51.764240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:51.764696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:51.765382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lazy-loading 'fault' on Instance uuid 02d59782-db8b-4885-a4ec-a57499c07fe1 {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:04:51.921636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:51.930702 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:51.932323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:51.933521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3e0c6e6b-5f78-4da0-a6d9-67449043da69 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 200 len: 1371 microversion: 2.20 time: 0.309110 May 24 10:04:51.934275 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 271/535] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:51 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:04:52.693755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:52.695127 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: e740327b-669e-49e2-9b7c-1f72d272e5e4] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:52.717507 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:52.717960 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:52.718766 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:52.719205 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:52.832283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] HTTP exception thrown: Instance e740327b-669e-49e2-9b7c-1f72d272e5e4 could not be found. May 24 10:04:52.834349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Returning 404 to user: Instance e740327b-669e-49e2-9b7c-1f72d272e5e4 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:04:52.835703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6215e0ad-75a3-4c03-999c-94daac3efa33 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4" status: 404 len: 111 microversion: 2.1 time: 0.148425 May 24 10:04:52.838105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 265/536] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:52 2021] GET /compute/v2.1/servers/e740327b-669e-49e2-9b7c-1f72d272e5e4 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:04:52.847117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:52.848382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:52.862529 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:52.862985 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:52.863979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:52.867765 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:52.959863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:52.960771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:52.964265 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:04:52.982310 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:52.987577 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:53.000130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:53.003065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:53.119003 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. May 24 10:04:53.119780 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:04:53.121522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0e576a23-bde0-4a1d-98d2-e73441fa3740 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 404 len: 111 microversion: 2.20 time: 0.165455 May 24 10:04:53.122423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 266/537] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:04:52 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:04:53.131674 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1d9e1aa1-e036-4c1d-aae0-c0044e9cf851 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '.version_select at 0x7f0a38490dc0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:53.286733 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1d9e1aa1-e036-4c1d-aae0-c0044e9cf851 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210612231" status: 204 len: 0 microversion: 2.20 time: 0.158812 May 24 10:04:53.288936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 267/538] 10.222.0.67 () {60 vars in 1259 bytes} [Mon May 24 10:04:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210612231 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:04:53.473939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d885a30b-fc3c-4dde-955a-aa1e84933ca6 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 204 len: 0 microversion: 2.1 time: 0.630277 May 24 10:04:53.481027 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 272/539] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:04:52 2021] DELETE /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:04:53.488087 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:53.489187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:53.499251 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:53.499711 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:53.500509 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:53.500953 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:53.903022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:53.912108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bf24ed2b-b70d-490a-9af8-c0abc419e4dd tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.428271 May 24 10:04:53.923007 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 268/540] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:53 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:54.930234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:54.930941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:54.939367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:54.939820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:54.940799 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:54.941271 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:55.026493 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: .version_select at 0x7f0a3831d940>, body: {"keypair": {"name": "tempest-keypair-980096240"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:55.062120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:04:55.069495 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:04:55.188475 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:55.203307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3988ae5e-5953-472b-9e4d-48ebfa26f72c tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.277102 May 24 10:04:55.212437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 273/541] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:54 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:55.506650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:04:55.513583 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:04:55.525843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e2c9d5ba-310a-4eeb-a1a5-1ec7fecdbcac tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.503941 May 24 10:04:55.526984 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 269/542] 10.222.0.67 () {62 vars in 1199 bytes} [Mon May 24 10:04:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 506 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 24 10:04:56.220847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:56.222126 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:56.233974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:56.234441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:56.235261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:56.235711 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:56.547774 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:56.557096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d7b10cf8-6e52-4f0e-aad2-97b5e68a4068 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.340536 May 24 10:04:56.558519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 274/543] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:56 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:04:57.583064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:57.584813 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:57.596592 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:57.597430 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:57.598765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:57.600770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:57.830419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:57.840073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-376a3264-0222-4b97-8297-b5ce46ad60f1 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.265441 May 24 10:04:57.852263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 270/544] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:57 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:04:58.811616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1734197947", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb75f5-deee-4236-9b04-1b6b5e617606"}], "security_groups": [{"name": "tempest-securitygroup--1067280220"}], "key_name": "tempest-keypair-980096240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:04:58.863330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:04:58.864295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:04:58.874597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:58.875292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:58.877186 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:04:58.878074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:04:59.125780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] validate_networks() for [('c1fb75f5-deee-4236-9b04-1b6b5e617606', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:04:59.163517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:04:59.175159 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bc26a2d3-10ee-4f84-93b9-b0e12a7f263e tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.318871 May 24 10:04:59.188700 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 271/545] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:04:58 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:00.192362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:00.194199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:00.203505 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:00.204856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:00.205931 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:00.206849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:00.279968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:05:00.279968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:05:00.280695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:05:00.281263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:05:00.281694 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:05:00.292821 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:00.293315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:00.294122 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:00.295085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:00.321355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:00.326383 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Getting quotas for user ee9a1c784bc4404782c67077a2cd8615 and project c42fc1bb2ae6477fa7b7c9261f2d50bb. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:00.338886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:05:00.341696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:05:00.504426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6faf4435-73f9-4b1f-b80f-a04753de30ba tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.704235 May 24 10:05:00.506501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 275/546] 10.222.0.67 () {62 vars in 1188 bytes} [Mon May 24 10:04:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 10:05:00.519994 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:00.521008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:00.718032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:00.733976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:00.736915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-53ebc4dc-9429-46ff-a7d5-dd90386b278f tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1520 microversion: 2.1 time: 0.548203 May 24 10:05:00.737445 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 272/547] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:00 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:00.751257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:00.752889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:00.754445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c27da7e6-e699-4672-9aa7-6b656141302c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1281 microversion: 2.20 time: 0.240762 May 24 10:05:00.755379 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 276/548] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:00 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:00.759279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-6c9cadf5-0cce-4dfb-81a8-42d13952e5a6 req-a0fb83dd-7bd7-4292-b66d-34d80335a65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b161895-21f1-4c71-9f5f-4d521eaea323", "name": "network-vif-deleted", "tag": "de553ab6-e238-403d-827d-b143492c1232"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:00.761312 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:00.761312 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:00.778568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6c9cadf5-0cce-4dfb-81a8-42d13952e5a6 req-a0fb83dd-7bd7-4292-b66d-34d80335a65e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:00.778568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6c9cadf5-0cce-4dfb-81a8-42d13952e5a6 req-a0fb83dd-7bd7-4292-b66d-34d80335a65e service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:00.793648 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-6c9cadf5-0cce-4dfb-81a8-42d13952e5a6 req-a0fb83dd-7bd7-4292-b66d-34d80335a65e service nova] Creating event network-vif-deleted:de553ab6-e238-403d-827d-b143492c1232 for instance 5b161895-21f1-4c71-9f5f-4d521eaea323 on hv-cinder-79123 May 24 10:05:00.800157 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-6c9cadf5-0cce-4dfb-81a8-42d13952e5a6 req-a0fb83dd-7bd7-4292-b66d-34d80335a65e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045044 May 24 10:05:00.800756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 273/549] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:01.753472 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:01.754098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:01.761690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:01.762150 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:01.762943 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:01.763950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:01.774395 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:01.775757 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:01.785683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:01.786179 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:01.788590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:01.790686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:01.946634 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:01.957629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:01.959496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:01.961467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ee529a04-1acf-4fdd-8eeb-f79628db7c13 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1285 microversion: 2.20 time: 0.192942 May 24 10:05:01.971864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 274/550] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:01 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:01.992571 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:02.002839 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e7d5bd87-c362-45e3-bba5-0c8b4ecd4016 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1478 microversion: 2.1 time: 0.253035 May 24 10:05:02.005022 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 277/551] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:01 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1478 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:02.983086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:02.984590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:02.994474 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:02.995389 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:02.996488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:02.997261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:03.026050 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:03.026677 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:03.039316 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:03.041555 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:03.042979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:03.043636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:03.249283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:03.267547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:03.278575 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6ddb36ff6fe49069f33f103f24f1264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08409afad374227ace1cdf31e4e9412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:03.284829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:03.289156 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0c97414e-0fe7-4458-ba2f-046a17a9cbf4 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 200 len: 1478 microversion: 2.1 time: 0.267324 May 24 10:05:03.290632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1536f4ec-d2fb-41fa-8939-35d13cd19ae4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1285 microversion: 2.20 time: 0.312790 May 24 10:05:03.291693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 275/552] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:02 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:03.292784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 278/553] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:03 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 1478 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:04.309336 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:04.309967 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] [instance: 5b161895-21f1-4c71-9f5f-4d521eaea323] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:04.317334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:04.317958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:04.329315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:04.329771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:04.330561 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:04.330998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:04.335086 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:04.335232 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:04.335971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:04.336412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:04.452617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] HTTP exception thrown: Instance 5b161895-21f1-4c71-9f5f-4d521eaea323 could not be found. May 24 10:05:04.453165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] Returning 404 to user: Instance 5b161895-21f1-4c71-9f5f-4d521eaea323 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:04.454018 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3caa6409-83c0-42ea-91bf-c0b58349b370 tempest-ServerRescueNegativeTestJSON-895971592 tempest-ServerRescueNegativeTestJSON-895971592-project] 10.222.0.67 "GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323" status: 404 len: 111 microversion: 2.1 time: 0.148841 May 24 10:05:04.461287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 276/554] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:04 2021] GET /compute/v2.1/servers/5b161895-21f1-4c71-9f5f-4d521eaea323 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:04.696073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:04.715027 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:04.717082 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:04.724891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-09b68f89-8599-4dce-883e-53b104dcbac2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1333 microversion: 2.20 time: 0.410470 May 24 10:05:04.725536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 279/555] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:04 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1333 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:05.744048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:05.745557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:05.754126 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:05.755329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:05.765185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:05.765185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:05.947030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:05.963336 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:05.964851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:05.966018 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0800e599-9538-43a0-a66a-185205eecf53 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1339 microversion: 2.20 time: 0.225895 May 24 10:05:05.966752 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 277/556] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:05 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1339 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:06.985025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:06.987975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:06.996267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:06.996721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:06.997537 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:06.997978 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:07.160231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:07.174515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:07.176783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:07.177913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-da497db9-6397-4a9c-a0da-6074cdf37dad tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1339 microversion: 2.20 time: 0.198116 May 24 10:05:07.178818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 280/557] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:06 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:08.197727 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:08.198974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:08.214670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:08.215137 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:08.215941 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:08.224209 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:08.556078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:08.573620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:08.576128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:08.577586 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8eb87f45-d010-435c-8ae1-718d4671195d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1339 microversion: 2.20 time: 0.384971 May 24 10:05:08.579828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 278/558] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:08 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:09.597501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:09.599090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:09.621769 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:09.622888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:09.623772 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:09.624226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:09.817606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:09.827261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:09.828820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:09.829955 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-74aa628a-006f-4995-a2a0-5554d92ff326 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1339 microversion: 2.20 time: 0.237411 May 24 10:05:09.830523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 281/559] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:09 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:10.848127 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:10.849423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:10.860680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:10.861170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:10.868971 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:10.869679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:11.244849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:11.256364 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:11.258660 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:11.260373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-60a029eb-d58d-4a04-9cc0-987c181cabfa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.416392 May 24 10:05:11.261560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 279/560] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:10 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:12.279604 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:12.280255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:12.304557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:12.304557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:12.304557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:12.304557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:12.967141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:12.967694 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:12.978914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:12.979388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:12.980185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:12.980627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:13.277389 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lazy-loading 'services' on Instance uuid 8315e706-66b1-49e6-a581-061abaf6c6db {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:05:13.462201 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:13.475179 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:13.480292 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:13.483277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6ab02970-b758-4081-8a40-d535310cc339 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 1.208541 May 24 10:05:13.486594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 282/561] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:12 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:13.499163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-66fa423e-700e-436f-b214-448ab3e94930 req-67cc7014-87de-4a35-85a1-fda44ecde930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812a56d8-d836-470a-b693-994765367aec", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:13.501221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:13.501221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:05:13.523208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-66fa423e-700e-436f-b214-448ab3e94930 req-67cc7014-87de-4a35-85a1-fda44ecde930 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:13.523669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-66fa423e-700e-436f-b214-448ab3e94930 req-67cc7014-87de-4a35-85a1-fda44ecde930 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:13.565134 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-66fa423e-700e-436f-b214-448ab3e94930 req-67cc7014-87de-4a35-85a1-fda44ecde930 service nova] Creating event network-changed:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:05:13.578791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-66fa423e-700e-436f-b214-448ab3e94930 req-67cc7014-87de-4a35-85a1-fda44ecde930 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090850 May 24 10:05:13.579386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 283/562] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:13.688299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1db9fd06-d893-4462-bcc5-b92f16888502 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db/os-volume_attachments/4200db51-8c7f-4d8a-9d43-a799cdafe496" status: 202 len: 0 microversion: 2.1 time: 0.724856 May 24 10:05:13.688885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 280/563] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:05:12 2021] DELETE /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db/os-volume_attachments/4200db51-8c7f-4d8a-9d43-a799cdafe496 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:14.504026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:14.505506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:14.518746 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:14.519219 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:14.523170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:14.523634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:14.990675 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:14.991965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:15.002124 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:15.002803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:15.003821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:15.004458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:15.102905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:05:15.158306 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:15.167673 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:15.170181 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:15.171564 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b1cb9c53-933a-4cef-8166-5f1375b7e458 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.671812 May 24 10:05:15.172661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 284/564] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:14 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:15.450020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7f194c0f-2b4b-4d3a-bff7-ddf77ecc2ffb tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 204 len: 0 microversion: 2.1 time: 0.462547 May 24 10:05:15.453792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 281/565] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:05:14 2021] DELETE /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:05:15.477657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:15.477657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:15.480354 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:15.480974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:15.481950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:15.482509 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:15.823543 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:15.832521 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e8c28d30-314b-49e7-ab6b-6c3037845652 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1512 microversion: 2.1 time: 0.369435 May 24 10:05:15.833090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 285/566] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:15 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:16.191926 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:16.192807 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:16.201578 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:16.202284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:16.203359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:16.203960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:16.298076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-56fd1d58-36c5-4bc1-aa04-e43b44db21c6 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Action: 'create', calling method: .version_select at 0x7f0a386b3700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2097312793"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:16.480284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:16.491808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:16.492642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:16.493900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ef360321-2b91-4773-aad1-d7b56290abb6 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.305975 May 24 10:05:16.494459 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 286/567] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:16 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:05:16.849984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:16.850619 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:16.858149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:16.858614 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:16.859399 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:16.859844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:17.079058 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:17.089616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ad02bd41-9a03-44af-ab42-5a2dcd2d0aae tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1512 microversion: 2.1 time: 0.243209 May 24 10:05:17.090535 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 287/568] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:16 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:17.467405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-56fd1d58-36c5-4bc1-aa04-e43b44db21c6 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.355011 May 24 10:05:17.468893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 282/569] 10.222.0.67 () {60 vars in 1155 bytes} [Mon May 24 10:05:16 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1359 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 10:05:17.479950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-250b30eb-5df5-459d-887a-eebf5d79e93e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a38f12af0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:17.511799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:17.512645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:17.536030 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:17.536905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:17.538642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:17.539319 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:17.689523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-250b30eb-5df5-459d-887a-eebf5d79e93e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 200 len: 345 microversion: 2.1 time: 0.213241 May 24 10:05:17.690643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 288/570] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:17 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 345 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:17.807990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:17.818678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:17.822928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:17.822928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b136788a-14a5-4b9c-830e-2679a0bff34b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.313961 May 24 10:05:17.822928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 283/571] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:17 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:05:18.107753 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:18.109129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:18.127359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:18.128111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:18.129447 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:18.130069 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:18.304582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:18.318193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ff76e39a-c7c3-48af-93e9-1222edc70d54 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1470 microversion: 2.1 time: 0.214876 May 24 10:05:18.319119 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 289/572] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:18 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:18.324835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-13595f0a-1c56-46e1-8a8e-220907420820 req-0eb64879-0408-46c7-a684-0872518fe8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8315e706-66b1-49e6-a581-061abaf6c6db", "name": "network-vif-deleted", "tag": "086b9a1c-9348-4b08-b6f7-f934b5e8aaa4"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:18.327229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:18.327229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:18.335973 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-13595f0a-1c56-46e1-8a8e-220907420820 req-0eb64879-0408-46c7-a684-0872518fe8b5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:18.338507 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-13595f0a-1c56-46e1-8a8e-220907420820 req-0eb64879-0408-46c7-a684-0872518fe8b5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:18.356601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-13595f0a-1c56-46e1-8a8e-220907420820 req-0eb64879-0408-46c7-a684-0872518fe8b5 service nova] Creating event network-vif-deleted:086b9a1c-9348-4b08-b6f7-f934b5e8aaa4 for instance 8315e706-66b1-49e6-a581-061abaf6c6db on hv-cinder-79123 May 24 10:05:18.362796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-13595f0a-1c56-46e1-8a8e-220907420820 req-0eb64879-0408-46c7-a684-0872518fe8b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042462 May 24 10:05:18.363768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 284/573] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:18.705422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b7a95db2-13bb-42c3-9896-9a50cfe38fb0 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a386b1550>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:18.810767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b7a95db2-13bb-42c3-9896-9a50cfe38fb0 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 200 len: 346 microversion: 2.1 time: 0.110257 May 24 10:05:18.813105 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 290/574] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:18 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:18.824295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-276a7a46-e483-4f89-9e03-7ed114c804aa tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Action: 'create', calling method: .version_select at 0x7f0a38212700>, body: {"snapshot": {"volume_id": "c20dd0fb-5545-4634-8080-266a8a6bf86e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1660443575"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:18.843672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:18.844297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:18.853264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:18.853725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:18.854619 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:18.855175 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:19.101906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:19.112406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:19.114089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:19.115357 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-58b48746-7882-4136-a199-58f67a700f3f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.275809 May 24 10:05:19.116308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 291/575] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:18 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:05:19.335834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:19.336381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:19.344427 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:19.344992 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:19.345824 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:19.346278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:19.417818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:19.418317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:19.418862 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lazy-loading 'fault' on Instance uuid 8315e706-66b1-49e6-a581-061abaf6c6db {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:05:19.797033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c525da11c94e1bb14cf55dda4c3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa87500244642ee805dba47191bc7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:19.799419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-276a7a46-e483-4f89-9e03-7ed114c804aa tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.979527 May 24 10:05:19.800094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 285/576] 10.222.0.67 () {60 vars in 1162 bytes} [Mon May 24 10:05:18 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:19.808940 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-43b19f23-d1cd-45b1-98ef-464830654a28 req-a8226bf5-71b6-4e7e-b631-4b746059e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a56d8-d836-470a-b693-994765367aec", "name": "network-vif-plugged", "status": "completed", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:19.809580 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3a97d8b4-6b09-4be6-bb74-ca09f09f88ed tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 200 len: 1308 microversion: 2.1 time: 0.477519 May 24 10:05:19.811378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:19.811378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:19.816118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 292/577] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:19 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:19.822901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-43b19f23-d1cd-45b1-98ef-464830654a28 req-a8226bf5-71b6-4e7e-b631-4b746059e8f3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:19.823221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e2df242f-5f92-49c8-aff2-395561295840 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385c0af0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:19.823304 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-43b19f23-d1cd-45b1-98ef-464830654a28 req-a8226bf5-71b6-4e7e-b631-4b746059e8f3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:19.841943 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-43b19f23-d1cd-45b1-98ef-464830654a28 req-a8226bf5-71b6-4e7e-b631-4b746059e8f3 service nova] Creating event network-vif-plugged:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:05:19.847067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-43b19f23-d1cd-45b1-98ef-464830654a28 req-a8226bf5-71b6-4e7e-b631-4b746059e8f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045533 May 24 10:05:19.847803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 286/578] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:19.875000 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e2df242f-5f92-49c8-aff2-395561295840 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.057473 May 24 10:05:19.875573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 293/579] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:19 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:19.885838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-57c292d7-9dfb-4586-9b03-7b3d1a84d77c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a38f63310>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:19.929140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-57c292d7-9dfb-4586-9b03-7b3d1a84d77c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047283 May 24 10:05:19.929720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 287/580] 10.222.0.67 () {58 vars in 1140 bytes} [Mon May 24 10:05:19 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:19.945617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1219de40-a64b-405a-9fb4-5c632119f8f4 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a38684550>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:19.992158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1219de40-a64b-405a-9fb4-5c632119f8f4 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.050121 May 24 10:05:19.992836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 294/581] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:19 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:20.134848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:20.136005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:20.147532 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:20.148250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:20.149126 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:20.149693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:20.396162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:20.406618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:20.408311 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:20.409778 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dc399b07-e731-4f77-a1fd-77e5ad9b1f5f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.278820 May 24 10:05:20.411249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 288/582] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:20 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:20.827491 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:20.828117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] [instance: 8315e706-66b1-49e6-a581-061abaf6c6db] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:20.836076 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:20.836536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:20.837340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:20.837782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:20.888881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] HTTP exception thrown: Instance 8315e706-66b1-49e6-a581-061abaf6c6db could not be found. May 24 10:05:20.889433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] Returning 404 to user: Instance 8315e706-66b1-49e6-a581-061abaf6c6db could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:20.890307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-05612110-88df-4ab5-b211-1087fc628657 tempest-VolumesSnapshotTestJSON-1598006192 tempest-VolumesSnapshotTestJSON-1598006192-project] 10.222.0.67 "GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db" status: 404 len: 111 microversion: 2.1 time: 0.067498 May 24 10:05:20.890867 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 295/583] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:20 2021] GET /compute/v2.1/servers/8315e706-66b1-49e6-a581-061abaf6c6db => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:20.957932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'create', calling method: .version_select at 0x7f0a385664c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1068774461"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:20.979914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:20.983923 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for user cf90f5b136f24a9c9c5de73a7eda3e0d and project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:21.004096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7b36ca9c-db3d-4bd8-af1e-a12fb4f03b00 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a38ef5f70>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:21.049559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7b36ca9c-db3d-4bd8-af1e-a12fb4f03b00 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.048914 May 24 10:05:21.050353 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 296/584] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:20 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:21.239440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:21.243322 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for user cf90f5b136f24a9c9c5de73a7eda3e0d and project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:21.256926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e12444bf-d8fe-4c6f-b676-1562b6714717 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.302661 May 24 10:05:21.257764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 289/585] 10.222.0.67 () {60 vars in 1158 bytes} [Mon May 24 10:05:20 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:21.364681 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-992966438", "imageRef": "a21a446a-2f2f-4593-93c8-9b0f53b23ff8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1068774461", "networks": [{"uuid": "d34a1523-ea50-45ad-a897-459ffff7af90"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:21.427654 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:21.428698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:21.437198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:21.438505 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:21.438628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] validate_networks() for [('d34a1523-ea50-45ad-a897-459ffff7af90', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:05:21.438714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:21.438872 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:21.688715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:21.697993 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:21.699893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:21.701060 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a5ebc8e1-a85f-4305-b856-aa6c77a09fb3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.277256 May 24 10:05:21.701836 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 290/586] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:21 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:05:22.061770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-de1d84d9-485b-4c70-b674-d6bdb9dff275 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a386b38b0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:22.090659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:05:22.091782 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:05:22.092242 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:05:22.092759 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:05:22.093116 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:05:22.101811 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:22.102269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:22.103081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:22.103524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:22.106756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-de1d84d9-485b-4c70-b674-d6bdb9dff275 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.048581 May 24 10:05:22.107327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 291/587] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:22 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:22.120930 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:22.125139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Getting quotas for user cf90f5b136f24a9c9c5de73a7eda3e0d and project 4b47c7cc67c545eab92ea86cde1abac7. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:22.136005 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:05:22.138813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a21a446a-2f2f-4593-93c8-9b0f53b23ff8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:05:22.255065 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-416ded4c-5d45-4b68-977e-12c4af661ab8 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894011 May 24 10:05:22.255714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 297/588] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:05:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:05:22.265966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a0c83432-98ee-4486-acfb-7513d2056818 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:22.266576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a0c83432-98ee-4486-acfb-7513d2056818 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:22.416091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a0c83432-98ee-4486-acfb-7513d2056818 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:22.425005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a0c83432-98ee-4486-acfb-7513d2056818 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1258 microversion: 2.1 time: 0.162943 May 24 10:05:22.425644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 292/589] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:22 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:22.725899 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:22.726887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:22.736542 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:22.737377 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:22.738194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:22.738646 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:22.954650 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:22.963526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:22.965033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:22.966241 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f44096a8-3f28-42a3-b32f-f7fe0d528dd2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.246138 May 24 10:05:22.966813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 298/590] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:22 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:23.118686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-23e96fdf-7d33-44e6-946f-eeb11902d503 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385669d0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:23.165537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-23e96fdf-7d33-44e6-946f-eeb11902d503 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.050621 May 24 10:05:23.166478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 293/591] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:23 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:23.445443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:23.446643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:23.459653 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.460105 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:23.462063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.462063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:23.544305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:23.544845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:23.553028 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.557894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:23.557894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.557894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:23.579460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:23.588054 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ecbec640-6f86-4947-8163-8382dd0183bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1262 microversion: 2.1 time: 0.149186 May 24 10:05:23.588898 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 299/592] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:23 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:23.618268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:05:23.983761 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:23.984418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:23.991797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.992255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:23.993044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:23.993584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:24.130630 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c8dc5be5-bfb2-4a0a-99c2-3ea93be65cee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 204 len: 0 microversion: 2.1 time: 0.588383 May 24 10:05:24.131429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 294/593] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:05:23 2021] DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:05:24.141749 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:24.142480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:24.150782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:24.151241 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:24.152282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:24.152734 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:24.225665 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:24.239390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:24.241409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:24.242757 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-57bffa86-a0d3-4c34-93f8-1786d16c2a05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1407 microversion: 2.20 time: 0.262773 May 24 10:05:24.243482 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 300/594] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:23 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:05:24.252841 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6e3ed49d-761e-4266-916c-4909ab1b8e5b tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a384689d0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:24.307484 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6e3ed49d-761e-4266-916c-4909ab1b8e5b tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 288 microversion: 2.1 time: 0.062268 May 24 10:05:24.308477 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 301/595] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:24 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:24.322597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-18b6f786-3daa-4f94-81de-fd2631d21c0a tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a397a9160>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:24.382371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:24.392362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6cb0c537-aa18-4d3d-8811-2b6a9bd66308 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1672 microversion: 2.1 time: 0.255837 May 24 10:05:24.392965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 295/596] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:24 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:24.605735 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:24.606240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:24.610204 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-18b6f786-3daa-4f94-81de-fd2631d21c0a tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 202 len: 0 microversion: 2.1 time: 0.291362 May 24 10:05:24.610891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 302/597] 10.222.0.67 () {58 vars in 1254 bytes} [Mon May 24 10:05:24 2021] DELETE /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:24.614803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:24.615264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:24.616063 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:24.616501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:24.619442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cd41b360-d3fc-4e21-ad8d-51cede07c668 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385c0430>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:24.670117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cd41b360-d3fc-4e21-ad8d-51cede07c668 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 200 len: 287 microversion: 2.1 time: 0.054047 May 24 10:05:24.670768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 303/598] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:24 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:24.729868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:24.738864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-570cfc72-51bc-496f-aa53-b2777b55be76 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1310 microversion: 2.1 time: 0.136926 May 24 10:05:24.739439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 296/599] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:24 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1310 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:25.272051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.272659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:25.280609 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.281083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.281845 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.282284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.410456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.411067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:25.418804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.419864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.420662 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.421140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.483030 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:25.492138 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:25.493879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:25.495254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-31c812ec-7942-4f82-a0c9-84023e5540d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1600 microversion: 2.20 time: 0.227030 May 24 10:05:25.496127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 304/600] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:05:25 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1600 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:05:25.512227 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.512749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:25.520280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.520830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.521753 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.522324 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.624537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:25.632853 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c26a89aa-28e3-4161-94ab-39650674255d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1672 microversion: 2.1 time: 0.226170 May 24 10:05:25.633681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 297/601] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:25 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:25.669985 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-49825b1d-cc19-4fd2-9995-cda9569f3902 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160746 May 24 10:05:25.670573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 305/602] 10.222.0.67 () {60 vars in 1316 bytes} [Mon May 24 10:05:25 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:05:25.682147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dbd010a4-bdfa-426f-b968-747c3222868c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a3831df70>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.723115 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-dbd010a4-bdfa-426f-b968-747c3222868c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] HTTP exception thrown: Snapshot 64fa307f-773a-43ac-bc86-01051818fe39 could not be found. May 24 10:05:25.723792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dbd010a4-bdfa-426f-b968-747c3222868c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Returning 404 to user: Snapshot 64fa307f-773a-43ac-bc86-01051818fe39 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:25.724701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dbd010a4-bdfa-426f-b968-747c3222868c tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39" status: 404 len: 111 microversion: 2.1 time: 0.046624 May 24 10:05:25.725593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 298/603] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:05:25 2021] GET /compute/v2.1/os-snapshots/64fa307f-773a-43ac-bc86-01051818fe39 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:25.733540 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e907ed68-60b8-48ee-b0af-4c26bc0bc9de tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385c0040>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.756655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:25.757305 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:25.776495 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.777083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.778253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:25.779521 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:25.900906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:25.910590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-49fe7dde-d450-4953-9dcf-300b05fc7daf tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1318 microversion: 2.1 time: 0.157573 May 24 10:05:25.911165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 299/604] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:25 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:26.027240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e907ed68-60b8-48ee-b0af-4c26bc0bc9de tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 202 len: 0 microversion: 2.1 time: 0.297207 May 24 10:05:26.028037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 306/605] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:05:25 2021] DELETE /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:26.037675 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b8cf79cd-1893-4291-bf01-a57e3ad52110 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a38fa0430>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:26.138732 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b8cf79cd-1893-4291-bf01-a57e3ad52110 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 200 len: 345 microversion: 2.1 time: 0.104517 May 24 10:05:26.139352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 300/606] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:26 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:26.653507 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:26.654051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:26.661658 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:26.662118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:26.662967 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:26.663416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:26.927702 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:26.928335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:26.935714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:26.936279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:26.937082 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:26.937526 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:27.051558 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:27.060136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f83fecaa-758e-4dcc-80cc-710ae044544e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1318 microversion: 2.1 time: 0.136196 May 24 10:05:27.060875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 301/607] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:26 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:27.142928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:27.152270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7dca4941-e9f1-430c-ae99-0d6cb154a890 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a3845f1f0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:27.155824 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-19503741-5575-4168-b867-92a7258ccb08 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1672 microversion: 2.1 time: 0.505771 May 24 10:05:27.157019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 307/608] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:26 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1672 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:27.250603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7dca4941-e9f1-430c-ae99-0d6cb154a890 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 200 len: 345 microversion: 2.1 time: 0.101862 May 24 10:05:27.251269 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 302/609] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:27 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:27.517165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-153a827d-c715-4a22-bd42-c288bea234da req-c5b6d77c-0c18-4576-af78-506abf9e3d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812a56d8-d836-470a-b693-994765367aec", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:27.518738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:27.518738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:27.524588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:27.525488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:27.535538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-153a827d-c715-4a22-bd42-c288bea234da req-c5b6d77c-0c18-4576-af78-506abf9e3d76 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:27.535979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-153a827d-c715-4a22-bd42-c288bea234da req-c5b6d77c-0c18-4576-af78-506abf9e3d76 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:27.537342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:27.538094 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:27.538886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:27.539401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:27.552218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-153a827d-c715-4a22-bd42-c288bea234da req-c5b6d77c-0c18-4576-af78-506abf9e3d76 service nova] Creating event network-changed:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:05:27.558240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-153a827d-c715-4a22-bd42-c288bea234da req-c5b6d77c-0c18-4576-af78-506abf9e3d76 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044979 May 24 10:05:27.559428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 303/610] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:27.788482 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-728bd02a-c14b-4491-abe5-f601350406ff tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 14 microversion: 2.20 time: 0.275904 May 24 10:05:27.789952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 308/611] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:27 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:28.085748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:28.093566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:28.119602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.120392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:28.128648 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.129627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:28.175357 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:28.176214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:28.194481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.195144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:28.197357 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.202918 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:28.662892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:28.678659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c7c139a5-7041-4f2d-b9f6-6d454068cacb tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1328 microversion: 2.1 time: 0.600542 May 24 10:05:28.679772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 304/612] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:28 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1328 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:28.685564 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-904cdf6b-2fb7-4d6a-9497-49a2685d5f42 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a382120d0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:28.771259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-904cdf6b-2fb7-4d6a-9497-49a2685d5f42 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] HTTP exception thrown: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. May 24 10:05:28.771868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-904cdf6b-2fb7-4d6a-9497-49a2685d5f42 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Returning 404 to user: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:28.772766 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-904cdf6b-2fb7-4d6a-9497-49a2685d5f42 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 404 len: 109 microversion: 2.1 time: 0.091952 May 24 10:05:28.773442 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 305/613] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:28 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:28.791309 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3eda3f8c-1012-4622-922b-142948ef1592 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385e6af0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:28.882020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-3eda3f8c-1012-4622-922b-142948ef1592 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] HTTP exception thrown: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. May 24 10:05:28.882901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3eda3f8c-1012-4622-922b-142948ef1592 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Returning 404 to user: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:28.883468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3eda3f8c-1012-4622-922b-142948ef1592 tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 404 len: 109 microversion: 2.1 time: 0.096279 May 24 10:05:28.884219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 306/614] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:05:28 2021] DELETE /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:28.901959 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:28.902966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:28.930105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.930562 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:28.933627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:28.934240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:29.082336 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-46d2116d-bfd2-44da-b2e9-ef4dd234bd9d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 14 microversion: 2.20 time: 0.196920 May 24 10:05:29.083474 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 307/615] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:28 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:29.089424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c27d54f9-b9c3-4333-9ff1-14eaee5d344e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Calling method '.version_select at 0x7f0a385e6ee0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:29.324867 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-c27d54f9-b9c3-4333-9ff1-14eaee5d344e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] HTTP exception thrown: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. May 24 10:05:29.326097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c27d54f9-b9c3-4333-9ff1-14eaee5d344e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] Returning 404 to user: Volume c20dd0fb-5545-4634-8080-266a8a6bf86e could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:29.326953 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c27d54f9-b9c3-4333-9ff1-14eaee5d344e tempest-VolumesSnapshotsTestJSON-849515910 tempest-VolumesSnapshotsTestJSON-849515910-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e" status: 404 len: 109 microversion: 2.1 time: 0.242206 May 24 10:05:29.327695 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 308/616] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:29 2021] GET /compute/v2.1/os-volumes/c20dd0fb-5545-4634-8080-266a8a6bf86e => generated 109 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:29.622932 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:29.639784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2d0cc0d8-6447-42ac-9e54-e5bb2aa2e2cb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1672 microversion: 2.1 time: 1.467786 May 24 10:05:29.642012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 309/617] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:28 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1672 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:29.725830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:29.725830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:29.732727 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:29.733408 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:29.734460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:29.735165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:30.060802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:30.076575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a4c64df2-ad63-4477-be3a-685e56f6031c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1316 microversion: 2.1 time: 0.382476 May 24 10:05:30.077197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 309/618] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:29 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:30.096719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:30.098630 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:30.123286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:30.124930 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:30.127333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:30.128538 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:30.220599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:05:30.221226 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:05:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:05:30.449194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cd6ccca7-cc33-40a2-9841-2efcfe908181 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 14 microversion: 2.20 time: 0.341480 May 24 10:05:30.449194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 310/619] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:30 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 14 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:30.661627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:30.663729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:30.694834 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:30.695287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:30.701762 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:30.702290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:30.987132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:31.020233 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5206c27f-ff09-4e22-b8f6-1955be4084f8 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1604 microversion: 2.1 time: 0.364168 May 24 10:05:31.032664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 310/620] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:30 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:31.109954 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:31.110834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:31.124946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:31.124946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:31.125616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:31.126220 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:31.463190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:31.470659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:31.503069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:31.503892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:31.505462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:31.506293 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:32.431143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:32.497394 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8acf2025-b134-425f-a51e-f1056b627e5a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 1.393359 May 24 10:05:32.515437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 311/621] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:31 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:32.515437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:32.520606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:32.554089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:32.554967 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:32.561500 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:32.563707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:33.004255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:33.021214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-80fdbe55-fbe1-4789-89d6-123d4da6b7b6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1604 microversion: 2.1 time: 0.519130 May 24 10:05:33.034081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 312/622] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:32 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1604 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:33.065858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-3f7a6420-1d5e-43a4-a60e-5df6956479a0 req-ad0972bf-0ddd-4be9-a823-6261ddd3ce9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b44b45-4a2f-48d5-851a-222d48691c7e", "name": "network-vif-deleted", "tag": "b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:33.067640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:33.067640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:05:33.074138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-222e7076-1bfd-4f58-a8a3-0c02c04d2f4f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 14 microversion: 2.20 time: 1.618875 May 24 10:05:33.080036 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 311/623] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:31 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 14 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:33.109206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3f7a6420-1d5e-43a4-a60e-5df6956479a0 req-ad0972bf-0ddd-4be9-a823-6261ddd3ce9b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:33.109751 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3f7a6420-1d5e-43a4-a60e-5df6956479a0 req-ad0972bf-0ddd-4be9-a823-6261ddd3ce9b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:33.168390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-3f7a6420-1d5e-43a4-a60e-5df6956479a0 req-ad0972bf-0ddd-4be9-a823-6261ddd3ce9b service nova] Creating event network-vif-deleted:b53384d6-69bf-43ea-b7ca-1bf1a5e0a26f for instance b5b44b45-4a2f-48d5-851a-222d48691c7e on hv-cinder-79123 May 24 10:05:33.181863 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-3f7a6420-1d5e-43a4-a60e-5df6956479a0 req-ad0972bf-0ddd-4be9-a823-6261ddd3ce9b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145797 May 24 10:05:33.185684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 313/624] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:33.526941 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:33.528028 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:33.554952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:33.556053 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:33.557262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:33.557963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:33.949710 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-cfc4575d-13ca-4793-8c43-ea1f9809ce8b req-85c9ba7e-69b9-4e39-b3d0-6d471de017c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:33.951569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:33.951569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:05:33.975131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-cfc4575d-13ca-4793-8c43-ea1f9809ce8b req-85c9ba7e-69b9-4e39-b3d0-6d471de017c0 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:33.975589 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-cfc4575d-13ca-4793-8c43-ea1f9809ce8b req-85c9ba7e-69b9-4e39-b3d0-6d471de017c0 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.028182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-cfc4575d-13ca-4793-8c43-ea1f9809ce8b req-85c9ba7e-69b9-4e39-b3d0-6d471de017c0 service nova] Creating event network-changed:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:05:34.046698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-cfc4575d-13ca-4793-8c43-ea1f9809ce8b req-85c9ba7e-69b9-4e39-b3d0-6d471de017c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109710 May 24 10:05:34.049415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 314/625] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:34.057028 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:34.063905 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:34.086598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:34.087077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.094406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:34.095091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.220110 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:34.242977 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5410fe21-f0a4-4e0b-96f0-1c3b52622cef tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.718384 May 24 10:05:34.244054 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 312/626] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:33 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:34.260998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:34.266981 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:34.296787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:34.299050 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.301183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:34.302770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.352724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:34.369997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:34.370613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lazy-loading 'fault' on Instance uuid b5b44b45-4a2f-48d5-851a-222d48691c7e {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:05:34.566605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:34.594549 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-11741d7e-97ad-413a-a9cf-215515682a49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 14 microversion: 2.20 time: 0.347463 May 24 10:05:34.595905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 313/627] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:34 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 14 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:34.623553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-24a2bc77-f2ef-49f4-81db-a6d027369478 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 200 len: 1327 microversion: 2.1 time: 0.572324 May 24 10:05:34.642223 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 315/628] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:34 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 1327 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:35.264997 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:35.265874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:35.274362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.275284 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.276002 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.276664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.613792 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:35.614768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:35.629214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.632599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.632599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.632599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.813280 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:35.827801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4111d67f-5c69-4762-9bb2-2d32f86c6b02 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.571122 May 24 10:05:35.828742 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 314/629] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:35 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:35.845327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:35.847726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:35.875374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.876096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.880024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:35.880997 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:35.987176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. May 24 10:05:35.987802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:05:35.988669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-74acab8c-ba90-410f-95d0-c17c8df24712 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 404 len: 111 microversion: 2.1 time: 0.158837 May 24 10:05:35.989806 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 315/630] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:35 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:05:36.002041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-72e180ba-c586-4095-968c-de547987e43c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '.version_select at 0x7f0a38317670>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:36.104482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-72e180ba-c586-4095-968c-de547987e43c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427146757" status: 202 len: 0 microversion: 2.1 time: 0.106875 May 24 10:05:36.105762 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 316/631] 10.222.0.67 () {58 vars in 1218 bytes} [Mon May 24 10:05:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427146757 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:36.853281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:36.854823 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:36.877434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:36.881256 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:36.882375 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:36.882579 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:37.408536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:37.417689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b5f699dd-6e87-49fa-be59-2717925eb8b5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.576174 May 24 10:05:37.418596 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 317/632] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:36 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:37.688660 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: .version_select at 0x7f0a38317820>, body: {"keypair": {"name": "tempest-keypair-450976120"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:37.724548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:37.729121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:38.348549 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:38.445796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:38.445796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-22d07dd4-bc1f-4b0c-aae2-71df0e81426f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.683373 May 24 10:05:38.445796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 318/633] 10.222.0.67 () {60 vars in 1158 bytes} [Mon May 24 10:05:37 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:38.445796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-14fe678f-2b41-40cf-b788-5dfedbe027e0 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a386b3700>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:38.480160 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-14fe678f-2b41-40cf-b788-5dfedbe027e0 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a9c72aba-d9cf-4546-b5fd-526d67f2004b" status: 200 len: 351 microversion: 2.1 time: 0.111029 May 24 10:05:38.491512 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 319/634] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:38 2021] GET /compute/v2.1/os-volumes/a9c72aba-d9cf-4546-b5fd-526d67f2004b => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:38.496885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:38.500492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:38.515335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:38.516907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:38.518352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:38.519376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:38.880763 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:38.900684 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-72bdaa93-6392-49c2-be5f-f268f3f29053 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.409006 May 24 10:05:38.902277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 320/635] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:38 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:39.930141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:39.930848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:39.939703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:39.943441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:39.943441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:39.943441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:40.331330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:40.340448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-025cc3fc-34a2-4907-9964-39a1d1bf3ac4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.413945 May 24 10:05:40.345802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 321/636] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:39 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:41.357374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:41.358143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:41.365433 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:41.365877 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:41.366651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:41.367091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:41.582725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:41.594815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c65952a7-a03c-4959-b7c1-eea569cabc1b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.241253 May 24 10:05:41.604281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 322/637] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:41 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:41.618980 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cadf2bdf-b6de-4464-9813-05996baf1344 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 22666 microversion: 2.20 time: 6.008618 May 24 10:05:41.625167 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 316/638] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:35 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 22666 bytes in 6013 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:42.337446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9ec215df-ac26-4f8d-bbad-5ebb4603ca78 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a381748b0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:42.436102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9ec215df-ac26-4f8d-bbad-5ebb4603ca78 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/3ac7427f-4cfa-4db3-b2df-b29640010a86" status: 200 len: 351 microversion: 2.1 time: 0.100514 May 24 10:05:42.436102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 323/639] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:42 2021] GET /compute/v2.1/os-volumes/3ac7427f-4cfa-4db3-b2df-b29640010a86 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:42.613011 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:42.614450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:42.623450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:42.624165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:42.625419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:42.625876 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:42.855598 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:42.856891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:42.864814 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:42.865306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:42.866098 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:42.866540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:42.969291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bffe2a88-37c5-4cae-84b9-b979e284f2f2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 23887 microversion: 2.20 time: 0.337780 May 24 10:05:42.973515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 324/640] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:42 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 23887 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:42.988671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:42.998561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-337d0856-2d18-42cb-b17e-1e1f6b340f2b tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.390204 May 24 10:05:42.999255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 317/641] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:42 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:43.040951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1499061145", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e28486c2-462f-406b-8c64-3246ae76f56c"}], "security_groups": [{"name": "tempest-securitygroup--245601581"}], "key_name": "tempest-keypair-450976120", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:43.261723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] validate_networks() for [('e28486c2-462f-406b-8c64-3246ae76f56c', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:05:43.946729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:05:43.947287 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:05:43.947639 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:05:43.948058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:05:43.948504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:05:43.957349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:43.957801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:43.958641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:43.959072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:43.979120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:05:43.982187 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:43.984036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:43.985866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Getting quotas for user 47e63eef5f9546018134fe3cee5da1a0 and project 3f91ad6930924a8d81ee21ec1c490828. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:05:43.993012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:43.993791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:43.994891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:43.995417 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:43.998693 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:05:44.006913 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:05:44.092838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1da82c0f-7efb-4ec4-b5c8-af822d95b4d2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 25627 microversion: 2.20 time: 0.115469 May 24 10:05:44.093532 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 318/642] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:43 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 25627 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:44.098684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.099391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:44.107381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:44.107879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:44.108725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:44.109202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:44.148315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c60e781b-9604-416f-b026-c3e4ce0f2e6c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.176235 May 24 10:05:44.149170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 325/643] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:05:42 2021] POST /compute/v2.1/servers => generated 401 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:05:44.160052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-20b3d754-90c5-4ee3-8b0f-7a200713ac6a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.160684 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-20b3d754-90c5-4ee3-8b0f-7a200713ac6a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:44.237230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-20b3d754-90c5-4ee3-8b0f-7a200713ac6a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:44.243201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-20b3d754-90c5-4ee3-8b0f-7a200713ac6a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1237 microversion: 2.1 time: 0.087992 May 24 10:05:44.253392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 326/644] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:44.327237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:44.335603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b3ec0d2a-44e3-4110-86c7-acee449228bc tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.240894 May 24 10:05:44.341634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 319/645] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:44.410069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3d1bcda3-9372-4c8d-a290-6513d93336e7 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a384908b0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.506752 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3d1bcda3-9372-4c8d-a290-6513d93336e7 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4070e4d8-ae06-43f9-b1a8-e83b1298912d" status: 200 len: 350 microversion: 2.1 time: 0.100908 May 24 10:05:44.507344 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 327/646] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes/4070e4d8-ae06-43f9-b1a8-e83b1298912d => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:44.518514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f7a12b08-bc97-4b59-a223-2eef13fdb3a5 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a38558670>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.602416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f7a12b08-bc97-4b59-a223-2eef13fdb3a5 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087656 May 24 10:05:44.602984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 320/647] 10.222.0.67 () {58 vars in 1134 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:44.615712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e402f77b-f6af-44bf-8dae-5e0e988c2245 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a3830d0d0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.697921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e402f77b-f6af-44bf-8dae-5e0e988c2245 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085737 May 24 10:05:44.698486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 328/648] 10.222.0.67 () {58 vars in 1149 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:44.710310 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c34d75b3-f53a-4c46-af33-ee599258445e tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a38684940>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.793479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c34d75b3-f53a-4c46-af33-ee599258445e tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086256 May 24 10:05:44.793705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 321/649] 10.222.0.67 () {58 vars in 1134 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:44.805576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4b911b04-366e-4f65-8b38-dc77e7c9612c tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a383a9af0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.886089 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4b911b04-366e-4f65-8b38-dc77e7c9612c tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084358 May 24 10:05:44.886672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 329/650] 10.222.0.67 () {58 vars in 1167 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:44.898154 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-14d8f669-5d2f-4202-b63f-be945ca120e6 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a385ed820>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:44.980309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-14d8f669-5d2f-4202-b63f-be945ca120e6 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085850 May 24 10:05:44.980882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 322/651] 10.222.0.67 () {58 vars in 1170 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:44.996722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-89d7bed2-daea-4ec9-a8ff-c6d51592a683 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a383a9f70>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:45.083721 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-89d7bed2-daea-4ec9-a8ff-c6d51592a683 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093484 May 24 10:05:45.084249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 330/652] 10.222.0.67 () {58 vars in 1155 bytes} [Mon May 24 10:05:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:45.095393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-78a911b9-5276-4e6a-8192-1e68db7b53ba tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a38684820>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:45.118227 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:45.123133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:45.132131 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.132604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.133410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.133962 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.181829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-78a911b9-5276-4e6a-8192-1e68db7b53ba tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089722 May 24 10:05:45.182562 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 323/653] 10.222.0.67 () {58 vars in 1188 bytes} [Mon May 24 10:05:45 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:45.195229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-18759b54-2307-42ec-b5fb-9256a07717b9 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] Calling method '.version_select at 0x7f0a38191700>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:45.233231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a0d746b3-a13a-4e59-870b-a9d3e2c9847a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 27041 microversion: 2.20 time: 0.132957 May 24 10:05:45.237593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 331/654] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:45 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 27041 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:45.261740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:45.263274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:45.272391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.272852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.273725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.274167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.282232 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-18759b54-2307-42ec-b5fb-9256a07717b9 tempest-VolumesTestJSON-56709092 tempest-VolumesTestJSON-56709092-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090228 May 24 10:05:45.282825 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 324/655] 10.222.0.67 () {58 vars in 1155 bytes} [Mon May 24 10:05:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:45.352243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:45.353361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:45.367768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.368383 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.369214 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:45.371506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:45.551911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:45.562328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1611b70a-ee70-4a6b-be49-2f9f1dd797b4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1241 microversion: 2.1 time: 0.304887 May 24 10:05:45.563524 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 332/656] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:45 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:45.621148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:45.632206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5d437034-077d-4df8-a6f3-138251b7078d tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.282484 May 24 10:05:45.632206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 325/657] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:45 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:46.245073 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:46.246061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:46.253371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.253821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.254591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.255025 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.355555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2da7ba7f-bb1d-4d30-a46c-a914a7a165a3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 27794 microversion: 2.20 time: 0.114055 May 24 10:05:46.356198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 333/658] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:46 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 27794 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:46.578937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:46.579635 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:46.587236 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.587700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.588506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.588951 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.649599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:46.650423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:46.663695 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.665040 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.666356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:46.666736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:46.728239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:46.741286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-27716674-d9af-488b-9fa7-76d8e57d6c10 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1297 microversion: 2.1 time: 0.166491 May 24 10:05:46.754705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 326/659] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:46 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1297 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:46.916880 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:46.926597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dfb718ec-8013-4c9b-88ba-11377fa9061a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.282266 May 24 10:05:46.927172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 334/660] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:46 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:47.367422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:47.368447 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:47.377308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.377873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.378696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.379137 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.482715 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8892d8a8-7f2e-4366-b313-6c75ba67bf22 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28162 microversion: 2.20 time: 0.118940 May 24 10:05:47.486983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 327/661] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:47 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28162 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:47.579932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-ba69f912-d661-4487-8f2f-a854f82f6cf9 req-243bceae-760c-4768-b177-e64a78f702ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "name": "network-vif-plugged", "status": "completed", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:47.581607 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:47.581607 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:47.590059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ba69f912-d661-4487-8f2f-a854f82f6cf9 req-243bceae-760c-4768-b177-e64a78f702ea service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.590509 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ba69f912-d661-4487-8f2f-a854f82f6cf9 req-243bceae-760c-4768-b177-e64a78f702ea service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.607510 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-ba69f912-d661-4487-8f2f-a854f82f6cf9 req-243bceae-760c-4768-b177-e64a78f702ea service nova] Creating event network-vif-plugged:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:05:47.612357 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-ba69f912-d661-4487-8f2f-a854f82f6cf9 req-243bceae-760c-4768-b177-e64a78f702ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036056 May 24 10:05:47.613353 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 335/662] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:47.760473 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:47.761212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:47.770567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.770969 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.771791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.772229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.944849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:47.945792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:47.962199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.962844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:47.963926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:47.964507 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:48.165833 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:48.176361 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-486f8ff4-7414-440b-8dca-67744338ad9a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.420147 May 24 10:05:48.177218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 328/663] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:47 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:48.295081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:48.303986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-26df479d-acfd-40cf-9173-721c4f518278 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1358 microversion: 2.1 time: 0.363515 May 24 10:05:48.304560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 336/664] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:47 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:48.495465 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:48.497672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:48.506755 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:48.507568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:48.508608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:48.509302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:48.614808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e690cd81-66eb-4532-86e6-064f24705776 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28162 microversion: 2.20 time: 0.123748 May 24 10:05:48.618950 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 329/665] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:48 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28162 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:49.194245 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:49.195463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:49.202747 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.203217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.204011 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.204460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.324180 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:49.325865 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:49.339229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.341246 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.342670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.343252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.448236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:49.457582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3badcb10-66f8-44d3-9c51-a6de324b4f68 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.267215 May 24 10:05:49.458180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 337/666] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:49 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:49.463468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-8046b024-575c-4976-b976-8c595ebe475c req-ec3e71c6-a16e-4f24-bfce-3c1fd79fed02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e8cab0-6add-4148-873b-9f1564abc530", "tag": "08d1ba31-f09e-4772-a2c3-16a65ba1761c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:49.465500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:49.465500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:49.476307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-8046b024-575c-4976-b976-8c595ebe475c req-ec3e71c6-a16e-4f24-bfce-3c1fd79fed02 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.476965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-8046b024-575c-4976-b976-8c595ebe475c req-ec3e71c6-a16e-4f24-bfce-3c1fd79fed02 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.496634 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-8046b024-575c-4976-b976-8c595ebe475c req-ec3e71c6-a16e-4f24-bfce-3c1fd79fed02 service nova] Creating event network-changed:08d1ba31-f09e-4772-a2c3-16a65ba1761c for instance 91e8cab0-6add-4148-873b-9f1564abc530 on hv-cinder-79123 May 24 10:05:49.501973 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-8046b024-575c-4976-b976-8c595ebe475c req-ec3e71c6-a16e-4f24-bfce-3c1fd79fed02 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042217 May 24 10:05:49.502731 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 338/667] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:49.627674 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:49.630290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:49.641845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.642623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.643813 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.644612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.744528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:49.753991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-79a08e84-4212-4ff0-984e-da645319f82a tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1548 microversion: 2.1 time: 0.435910 May 24 10:05:49.754332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 330/668] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:49 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1548 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:49.771274 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:49.772616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:49.776579 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a3b7ccba-f80f-447d-a6f3-5c72c4432343 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28453 microversion: 2.20 time: 0.153207 May 24 10:05:49.778890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 339/669] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:49 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:49.785262 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.785750 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:49.786584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:49.787291 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.211637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:50.220617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7c2b8570-76d1-4747-85d8-87719dc6649c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1548 microversion: 2.1 time: 0.454653 May 24 10:05:50.232019 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 331/670] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:49 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1548 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:50.237997 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:50.241392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:50.241392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:50.242441 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:50.243200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Searching by: {'deleted': False, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7'} {{(pid=123672) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 24 10:05:50.249319 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.249782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.250598 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.251031 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.345424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.multi_cell_list [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123672) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 24 10:05:50.449141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d32225e3-d88b-4897-98cd-754d38dfd9a4 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215317 May 24 10:05:50.449725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 340/671] 10.222.0.67 () {58 vars in 1125 bytes} [Mon May 24 10:05:50 2021] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:50.461216 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:50.461894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:50.470567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.471240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.472195 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.472781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.476748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:50.478048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:50.488486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.488956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.490014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.490730 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.789295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:50.798894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ff14c4fa-1994-4437-8d27-92e04e034b14 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.327067 May 24 10:05:50.799917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 341/672] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:50 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:05:50.816216 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:50.816216 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:50.820924 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.822146 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.823783 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:50.824587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:50.838658 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:50.852044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-852fa639-f167-4af8-8c06-9ec052c1b109 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1548 microversion: 2.1 time: 0.395091 May 24 10:05:50.855194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 332/673] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:50 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1548 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:50.964142 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-36308e15-2735-44a6-9d2c-3618c0d94d0c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28596 microversion: 2.20 time: 0.162547 May 24 10:05:50.966313 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 342/674] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:50 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28596 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:51.815608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:51.816253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:51.824435 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:51.826222 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:51.827163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:51.827852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:51.977608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:51.979386 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:51.989413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:51.989795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:51.990781 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:51.991230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:52.091922 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6eeaab1b-a72f-4ca1-bcc1-a2761a26ac41 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28621 microversion: 2.20 time: 0.118126 May 24 10:05:52.095841 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 343/675] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:51 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28621 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:52.120779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:52.130108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6e879549-0827-41a1-97c7-7a1ecd687734 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.318084 May 24 10:05:52.130687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 333/676] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:51 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:53.104594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:53.107064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:53.117770 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.118499 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.119443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.120033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.149659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:53.150870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:53.161441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.162205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.163230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.163869 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.242655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-21a2f0a7-0ac0-4ecc-9b04-f894f0f6eff4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28621 microversion: 2.20 time: 0.142193 May 24 10:05:53.248076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 344/677] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:53 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:53.249723 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a78cdab9-0f94-473e-b606-26cbff39b40e"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:53.251203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:53.260588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.261175 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.262056 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:53.262604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:53.373479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:53.392143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e6e6ef88-c839-4289-8a93-deb5a199135f tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.248368 May 24 10:05:53.393001 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 334/678] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:53 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:54.183139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-160ad073-e033-44b4-99f2-59d2e21a0971 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938329 May 24 10:05:54.185463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 345/679] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:05:53 2021] POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:54.255991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:54.257415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:54.266617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:54.267384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:54.268366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:54.268805 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:54.406895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bf188079-22db-4b7d-9d51-eefbd02f6d7d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 28621 microversion: 2.20 time: 0.150743 May 24 10:05:54.406895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 335/680] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:54 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 28621 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:54.411863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:54.413022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:54.422683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:54.423571 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:54.424541 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:54.424989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:54.784716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:54.794407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-03f49583-8a93-463d-8da4-1c0f940b5078 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.387651 May 24 10:05:54.795024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 346/681] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:54 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:55.423185 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:55.423185 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:55.430827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:55.431460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:55.432289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:55.432733 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:55.535525 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-61b5071b-7b8e-49f1-8270-3a263f4791c8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 29737 microversion: 2.20 time: 0.122698 May 24 10:05:55.536921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 336/682] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:55 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 29737 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:55.692288 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-d7971442-70bc-4647-a601-8b2bbeb73644 req-0a37ece3-42ad-4c01-8849-6c89ca08c0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e8cab0-6add-4148-873b-9f1564abc530", "name": "network-vif-plugged", "status": "completed", "tag": "08d1ba31-f09e-4772-a2c3-16a65ba1761c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:55.694370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:05:55.694370 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:05:55.703720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d7971442-70bc-4647-a601-8b2bbeb73644 req-0a37ece3-42ad-4c01-8849-6c89ca08c0a0 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:55.704162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d7971442-70bc-4647-a601-8b2bbeb73644 req-0a37ece3-42ad-4c01-8849-6c89ca08c0a0 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:55.720873 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-d7971442-70bc-4647-a601-8b2bbeb73644 req-0a37ece3-42ad-4c01-8849-6c89ca08c0a0 service nova] Creating event network-vif-plugged:08d1ba31-f09e-4772-a2c3-16a65ba1761c for instance 91e8cab0-6add-4148-873b-9f1564abc530 on hv-cinder-79123 May 24 10:05:55.725681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-d7971442-70bc-4647-a601-8b2bbeb73644 req-0a37ece3-42ad-4c01-8849-6c89ca08c0a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038738 May 24 10:05:55.726290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 347/683] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:05:55.813793 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:55.815029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:55.823778 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:55.824349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:55.825453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:55.826070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:56.044881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:56.055834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5af2773a-617e-4a5a-9a4a-ea16d9dc8393 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.247316 May 24 10:05:56.057169 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 337/684] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:55 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:56.550244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:56.551451 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:56.564033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:56.564603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:56.565768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:56.566219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:56.679470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-330ae8ea-96eb-4aca-8f85-492b653c289c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 31492 microversion: 2.20 time: 0.134569 May 24 10:05:56.680451 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 348/685] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:56 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 31492 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:57.072826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:57.073514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:57.084127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:57.084588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:57.085486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:57.086184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:57.301351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:57.310390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c92484ae-6858-4ccd-aa11-9099a6b1cb8c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1362 microversion: 2.1 time: 0.241302 May 24 10:05:57.319864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 338/686] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:57 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:57.692942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:57.694337 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:57.703566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:57.704019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:57.704812 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:57.705291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:57.818575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ada0014b-d2ab-487b-be0c-81e7081f45f1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 32917 microversion: 2.20 time: 0.130280 May 24 10:05:57.819233 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 349/687] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:57 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 32917 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:05:58.332830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:58.333693 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:58.341888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.342349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.343142 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.343640 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.559319 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:05:58.568203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7a2352db-b141-42b2-afca-606c43fc3329 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1547 microversion: 2.1 time: 0.244567 May 24 10:05:58.569168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 339/688] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:05:58 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:05:58.593418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:58.594482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:58.604805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.605502 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.606928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.607627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.835429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:58.836274 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:58.843639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.844102 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.845115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:58.845557 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:58.924024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7d494b4b-c358-48e5-b61f-414824d913e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337134 May 24 10:05:58.924602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 350/689] 10.222.0.67 () {58 vars in 1275 bytes} [Mon May 24 10:05:58 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-interface => generated 284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:58.949010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5c7f7f7f-bf04-4ac4-8a77-dbaaf6b07970 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 33985 microversion: 2.20 time: 0.117245 May 24 10:05:58.953430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 340/690] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:58 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 33985 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 24 10:05:59.961388 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:05:59.962348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:05:59.970930 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:59.971510 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:05:59.972382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:05:59.973161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:00.085323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a691a3ba-6c74-4978-a9be-cb02b70c6f49 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 34973 microversion: 2.20 time: 0.127358 May 24 10:06:00.086007 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 351/691] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:05:59 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 34973 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:01.007091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:01.010129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:01.022208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:01.022983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:01.023992 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:01.024681 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:01.160573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-6de1f8c2-df0f-4a0e-b7dc-09d767fc8d15 req-a20ac819-841e-4341-a34e-841e6c4f0a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e8cab0-6add-4148-873b-9f1564abc530", "tag": "08d1ba31-f09e-4772-a2c3-16a65ba1761c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:01.162878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:01.162878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:06:01.174267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6de1f8c2-df0f-4a0e-b7dc-09d767fc8d15 req-a20ac819-841e-4341-a34e-841e6c4f0a12 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:01.175003 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6de1f8c2-df0f-4a0e-b7dc-09d767fc8d15 req-a20ac819-841e-4341-a34e-841e6c4f0a12 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:01.184481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-aa77461b-45be-4073-9e1d-dabaa1212288 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.181988 May 24 10:06:01.188749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 341/692] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:01 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:01.195187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-6de1f8c2-df0f-4a0e-b7dc-09d767fc8d15 req-a20ac819-841e-4341-a34e-841e6c4f0a12 service nova] Creating event network-changed:08d1ba31-f09e-4772-a2c3-16a65ba1761c for instance 91e8cab0-6add-4148-873b-9f1564abc530 on hv-cinder-79123 May 24 10:06:01.201582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-6de1f8c2-df0f-4a0e-b7dc-09d767fc8d15 req-a20ac819-841e-4341-a34e-841e6c4f0a12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195458 May 24 10:06:01.201908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:01.203078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 352/693] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:06:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:01.203913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:01.224560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:01.225324 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:01.226701 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:01.227209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:01.350535 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-24652e7b-7e4c-4a25-aa36-9ae0c242aa75 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 35815 microversion: 2.20 time: 0.159849 May 24 10:06:01.354440 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 342/694] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:01 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 35815 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:02.198455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:02.199469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:02.212380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.218646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.218646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.218646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.336411 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-22f5efd5-373e-4a8b-9880-f1b4dc3c7645 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.142274 May 24 10:06:02.339677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 353/695] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:02 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:02.364445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:02.365615 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:02.382915 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.383596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.384577 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.385220 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.394789 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:02.395502 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:02.416077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.416533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.417348 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:02.418202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:02.523056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1d5a19bb-3a90-4b85-b3f7-7da0a1c719be tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 37153 microversion: 2.20 time: 0.163150 May 24 10:06:02.524006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 343/696] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:02 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 37153 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:02.727074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:02.742377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2191a631-aadd-46e7-b5f0-90eb787f225c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1594 microversion: 2.1 time: 0.351594 May 24 10:06:02.744779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 354/697] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:02 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1594 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:03.356455 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:03.357984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:03.367705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:03.370044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:03.372065 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:03.372700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:03.491102 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e62d978c-e61a-466b-92b7-77eba3896da9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.142280 May 24 10:06:03.493140 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 344/698] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:03 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:03.535708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:03.536654 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:03.545338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:03.546072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:03.547058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:03.547721 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:03.667366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c9e0d374-49ab-4814-9ef8-caf50e168549 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 38177 microversion: 2.20 time: 0.134803 May 24 10:06:03.669461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 355/699] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:03 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 38177 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:04.503838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:04.504996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:04.524516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:04.525010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:04.525752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:04.526197 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:04.665474 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d4137717-d9a4-4985-9c2a-c6fd56188861 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.165537 May 24 10:06:04.666781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 345/700] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:04 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:04.680677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:04.681762 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:04.694691 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:04.695454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:04.696468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:04.696912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:04.810187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e49304d5-2502-4f75-b2aa-8c0505772202 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 38177 microversion: 2.20 time: 0.132944 May 24 10:06:04.812535 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 356/701] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:04 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 38177 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:05.678624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:05.681299 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:05.690358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:05.691234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:05.692252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:05.692891 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:05.816418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e5ff2ba5-eb93-4cdb-a999-1ed2b12f1d28 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.141281 May 24 10:06:05.821742 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 346/702] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:05 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:05.833428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:05.837470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:05.858411 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:05.865538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:05.868544 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:05.869034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:05.989297 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-01b63638-6784-4c50-9046-5df33bc5c331 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 38177 microversion: 2.20 time: 0.166934 May 24 10:06:05.992722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 357/703] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:05 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 38177 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:06.351491 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-d565b52e-b111-4808-86c2-487850223eb2 req-a17a094c-f4ff-4b8e-9582-f04db2b83639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:06.353968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:06.353968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:06:06.366594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-d565b52e-b111-4808-86c2-487850223eb2 req-a17a094c-f4ff-4b8e-9582-f04db2b83639 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:06.367236 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-d565b52e-b111-4808-86c2-487850223eb2 req-a17a094c-f4ff-4b8e-9582-f04db2b83639 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:06.386075 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-d565b52e-b111-4808-86c2-487850223eb2 req-a17a094c-f4ff-4b8e-9582-f04db2b83639 service nova] Creating event network-changed:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:06:06.397886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-d565b52e-b111-4808-86c2-487850223eb2 req-a17a094c-f4ff-4b8e-9582-f04db2b83639 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059324 May 24 10:06:06.402145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 347/704] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:06:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:06.833965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:06.835067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:06.855103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:06.860330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:06.861543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:06.867212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:07.005327 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:07.006445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:07.027645 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:07.028830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:07.031428 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:07.031908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:07.158223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dacd73a0-ca34-4baa-877a-eaa1405c7b44 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.329362 May 24 10:06:07.159982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 358/705] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:06 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:07.261306 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-51b40a55-fae9-4e45-9ad3-b7bc326aabb0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 200 len: 38320 microversion: 2.20 time: 0.260669 May 24 10:06:07.266496 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 348/706] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:06 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 38320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:07.285767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:07.287540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:07.309368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:07.310536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:07.312260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:07.316421 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:07.473434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8e64ca8f-fc44-4921-ad70-3261d4904044 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/ips" status: 200 len: 152 microversion: 2.20 time: 0.196095 May 24 10:06:07.484278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 359/707] 10.222.0.67 () {60 vars in 1289 bytes} [Mon May 24 10:06:07 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/ips => generated 152 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:08.179085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:08.188258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:08.214285 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:08.218269 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:08.223060 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:08.223874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:08.441654 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-00f2b821-2798-462d-8e3c-872f30c99eb9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.271879 May 24 10:06:08.445350 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 349/708] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:08 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:09.457139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:09.458531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:09.468504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:09.469138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:09.470115 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:09.470841 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:09.588699 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-acf6964f-a8c1-4152-9393-9910dc0f00eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.136068 May 24 10:06:09.590263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 360/709] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:09 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:10.602865 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:10.603817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:10.612566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:10.613037 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:10.613872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:10.614679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:10.720094 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-62bf29ca-2d10-48b2-a361-00c8de86c0df tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 14 microversion: 2.1 time: 0.121761 May 24 10:06:10.723413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 350/710] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:10 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:06:11.501089 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:11.505184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:11.521564 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:11.522969 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:11.525709 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:11.526591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:11.594554 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lazy-loading 'flavor' on Instance uuid 812a56d8-d836-470a-b693-994765367aec {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:06:11.641496 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-205366445"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:11.642130 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:11.654788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:11.655121 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:11.655927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:11.656421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:12.038804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.network.security_group_api [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Adding security group 74db5aed-164a-4d86-968e-bc83de180d04 to port fb9be3d2-4022-41e3-825a-ddf6079de0ba May 24 10:06:12.467439 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-30dc2586-21f1-4b5a-857e-7e44849fb737 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 202 len: 0 microversion: 2.20 time: 0.975447 May 24 10:06:12.476038 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 361/711] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:11 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 0 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:06:12.487462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:12.489403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:12.505847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:12.506771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:12.511035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:12.513479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:12.700271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ff7f732a-f4a3-40ee-aecd-724dc866b3eb tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 8168 microversion: 2.1 time: 0.218631 May 24 10:06:12.701572 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 362/712] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:12 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 8168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:12.708779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:12.710071 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:12.722123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:12.723072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:12.724092 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:12.724894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.038661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0023a315-b3fd-4e0b-817f-ed798b0d1687 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action" status: 202 len: 0 microversion: 2.1 time: 1.402537 May 24 10:06:13.042464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 351/713] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:11 2021] POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action => generated 0 bytes in 1406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:13.048606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:13.049563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:13.072647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:13.073331 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.074445 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:13.075439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.207951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:13.221767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:13.223814 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:13.226452 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7f212a2e-6272-47b9-b3d4-b07b77f2bdae tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.522659 May 24 10:06:13.227374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 363/714] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:12 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:13.593626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:13.608460 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a6e850c5-d106-4272-a913-08fbc194390c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1758 microversion: 2.1 time: 0.563689 May 24 10:06:13.611993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 352/715] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:13 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1758 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:13.642703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-eeff821c-e59d-4565-8b68-70f760d1fcdd req-9a4d9098-72f1-412f-87f3-a092bb1cca3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:13.676722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:13.676722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:06:13.676722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-eeff821c-e59d-4565-8b68-70f760d1fcdd req-9a4d9098-72f1-412f-87f3-a092bb1cca3b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:13.676722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-eeff821c-e59d-4565-8b68-70f760d1fcdd req-9a4d9098-72f1-412f-87f3-a092bb1cca3b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.713593 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:13.734114 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:13.735416 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:13.737236 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.738096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:13.738542 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:13.750142 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-eeff821c-e59d-4565-8b68-70f760d1fcdd req-9a4d9098-72f1-412f-87f3-a092bb1cca3b service nova] Creating event network-changed:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:06:13.755663 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-eeff821c-e59d-4565-8b68-70f760d1fcdd req-9a4d9098-72f1-412f-87f3-a092bb1cca3b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515944 May 24 10:06:13.756496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 364/716] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:13.885630 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4cee17cd-eea4-41a0-86a9-fa39e2aeceff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 15332 microversion: 2.1 time: 0.176205 May 24 10:06:13.886538 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 353/717] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:13 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 15332 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:14.246874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:14.247644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:14.267415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:14.268384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:14.270176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:14.271147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:14.898872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:14.899925 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:14.920955 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:14.921461 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:14.922298 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:14.922749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:15.106259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0582d277-e449-4d24-9f1f-753e3d51089c tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 18449 microversion: 2.1 time: 0.210878 May 24 10:06:15.111270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 354/718] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:14 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 18449 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:15.147755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:15.165820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:15.169454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:15.171318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-55149a4d-95f9-418a-951d-275b3b271a4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.929308 May 24 10:06:15.183125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 365/719] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:14 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:16.126457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:16.128291 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:16.150745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:16.151573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:16.153931 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:16.154745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:16.191198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:16.191937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:16.206294 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:16.206743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:16.210764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:16.211432 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:16.276158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a16e96f3-ac21-4d9e-ae1f-4e47d519bae1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 20271 microversion: 2.1 time: 0.158249 May 24 10:06:16.277096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 355/720] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:16 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 20271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:16.665794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:16.682864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:16.686793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:16.688824 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dc1c3447-776a-4486-89f1-9d6fde702b1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.501718 May 24 10:06:16.689836 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 366/721] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:16 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:17.291670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:17.293544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:17.302932 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:17.303380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:17.304390 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:17.304831 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:17.421034 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a328133b-9ed1-4a8c-9021-2ed7d96ff593 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 22772 microversion: 2.1 time: 0.133367 May 24 10:06:17.422977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 356/722] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:17 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 22772 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:17.713678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:17.714624 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:17.728243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:17.728979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:17.730327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:17.731918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:18.225109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:18.235807 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:18.237615 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:18.238794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e28a9d60-006c-4bc4-9846-4717754271e3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.532096 May 24 10:06:18.239440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 367/723] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:17 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:18.437878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:18.439845 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:18.450483 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:18.451004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:18.451956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:18.452680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:18.592267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6399da9f-af35-4599-8901-818108aee81d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 23804 microversion: 2.1 time: 0.160607 May 24 10:06:18.596182 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 357/724] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:18 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 23804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:19.259419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:19.261795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:19.279788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:19.280611 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:19.284021 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:19.284835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:19.604602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:19.606697 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:19.615241 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:19.615956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:19.617041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:19.617533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:19.748924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-33b0cdb4-d46f-4d88-83dc-b7f765b89f46 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 25262 microversion: 2.1 time: 0.148318 May 24 10:06:19.753213 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 358/725] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:19 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 25262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:19.827914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:19.842843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:19.846540 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:19.848813 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1884362e-259d-4080-bebe-f34979c1cd5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.594450 May 24 10:06:19.849875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 368/726] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:19 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:20.764033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:20.768005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:20.788415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:20.789242 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:20.791128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:20.793006 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:20.948991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Action: 'create', calling method: .version_select at 0x7f0a38377040>, body: {"keypair": {"name": "tempest-TestShelveInstance-899814628"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:20.970593 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ff16dad5-2d12-4c1c-aa6a-e60a1fc117ab tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 26894 microversion: 2.1 time: 0.212288 May 24 10:06:20.971266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 369/727] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:20 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 26894 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:20.977742 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:20.978845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:20.988938 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:20.989454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:20.990511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:20.991015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:21.014768 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for project ce96e2adbf10489aae7640c84f398b29. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:06:21.022602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for user 76d89f739ff940bc835dbe914ebc7043 and project ce96e2adbf10489aae7640c84f398b29. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:06:21.325553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:21.336802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:21.338667 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:21.340878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7dce9b7a-8173-44f8-9684-da93092944d1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.367754 May 24 10:06:21.341851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 370/728] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:20 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:21.479087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for project ce96e2adbf10489aae7640c84f398b29. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:06:21.484667 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for user 76d89f739ff940bc835dbe914ebc7043 and project ce96e2adbf10489aae7640c84f398b29. Resources: {'key_pairs'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:06:21.502172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-91c9fdaa-0aa7-4b5f-86ae-11a66451ab3e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.812124 May 24 10:06:21.502886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 359/729] 10.222.0.67 () {60 vars in 1158 bytes} [Mon May 24 10:06:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:21.985758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:21.987786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:22.004018 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:22.005271 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:22.006922 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:22.008068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:22.172059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-65512a04-c394-429a-83c9-fdb22cd97f1b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 27630 microversion: 2.1 time: 0.189206 May 24 10:06:22.173614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 371/730] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:21 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 27630 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:22.366567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:22.367976 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:22.384239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:22.386957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:22.389245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:22.390297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:22.845837 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:22.858553 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:22.860382 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:22.861811 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cae7a3c3-b22a-4f48-a03f-f8063652a7c3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.505018 May 24 10:06:22.879358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 360/731] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:22 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:23.193605 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:23.196555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:23.215772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:23.217173 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:23.218994 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:23.220187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:23.352133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-56028dc6-01ec-498f-9880-1773eb9537f9 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28033 microversion: 2.1 time: 0.167439 May 24 10:06:23.357200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 372/732] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:23 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28033 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:23.905501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:23.906785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:23.916440 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:23.917095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:23.917993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:23.919121 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:24.284398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:24.295308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:24.296900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:24.298292 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7f484829-9e60-44f4-9f63-a04d5a36eadb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1745 microversion: 2.20 time: 0.405756 May 24 10:06:24.299240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 361/733] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:23 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1745 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:24.373799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:24.377252 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:24.389935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:24.390482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:24.391520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:24.392104 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:24.508043 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-24b25dd9-bf74-49c9-ab0e-5ea26256df04 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28176 microversion: 2.1 time: 0.147213 May 24 10:06:24.508794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 373/734] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:24 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28176 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:25.318777 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:25.319634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:25.328993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:25.329478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:25.335117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:25.335117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:25.520786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:25.521836 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:25.532341 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:25.534921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:25.534921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:25.534921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:25.596669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:25.606411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:25.612929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:25.619874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4df616f8-90c0-43dc-9198-590d31e1c3ca tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1745 microversion: 2.20 time: 0.305237 May 24 10:06:25.620659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 362/735] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:25 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1745 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:25.667380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f03051a6-a923-4991-99ae-ca50da13408d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28176 microversion: 2.1 time: 0.150420 May 24 10:06:25.681788 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 374/736] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:25 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28176 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:26.653342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:26.657251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:26.669115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:26.670398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:26.671728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:26.672607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:26.695161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:26.698362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:26.716834 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:26.718263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:26.719635 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:26.720852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:26.914443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-59bf96b7-2f5b-4c76-942b-25a299b52c15 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28176 microversion: 2.1 time: 0.230491 May 24 10:06:26.915901 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 375/737] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:26 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28176 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:27.002429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:27.013597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:27.015229 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:27.016686 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-077cf1cd-c38e-4eb9-9378-d0a7f8f49456 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1745 microversion: 2.20 time: 0.370145 May 24 10:06:27.017399 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 363/738] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:26 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1745 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:27.942389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:27.959604 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:27.965614 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:27.967631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:27.969643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:27.970880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:28.086279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-e2a9623e-9682-4f4b-b5e9-58c563fa33df req-b75d13e1-d099-4eac-b8d3-4c6490239d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a56d8-d836-470a-b693-994765367aec", "name": "network-vif-plugged", "status": "completed", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:28.088972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:28.088972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:06:28.099037 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-e2a9623e-9682-4f4b-b5e9-58c563fa33df req-b75d13e1-d099-4eac-b8d3-4c6490239d14 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:28.099488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-e2a9623e-9682-4f4b-b5e9-58c563fa33df req-b75d13e1-d099-4eac-b8d3-4c6490239d14 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:28.119588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-e2a9623e-9682-4f4b-b5e9-58c563fa33df req-b75d13e1-d099-4eac-b8d3-4c6490239d14 service nova] Creating event network-vif-plugged:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:06:28.129359 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-e2a9623e-9682-4f4b-b5e9-58c563fa33df req-b75d13e1-d099-4eac-b8d3-4c6490239d14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289653 May 24 10:06:28.129359 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 376/739] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:06:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:28.132288 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:28.132822 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:28.143376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:28.143552 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:28.144385 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:28.144830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:28.156203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2037949d-8a1c-420c-9338-a5969b852964 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28304 microversion: 2.1 time: 0.229550 May 24 10:06:28.168349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 364/740] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:27 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:28.493993 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:28.507491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:28.509795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:28.511180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f3b25e48-3cdb-42ff-8369-3b95ba2429d4 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.383339 May 24 10:06:28.512045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 377/741] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:28 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:29.180806 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:29.182511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:29.193944 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:29.195585 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:29.197908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:29.198618 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:29.333784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d44726f4-53b0-4901-afae-928f1185a5ed tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28466 microversion: 2.1 time: 0.158497 May 24 10:06:29.335226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 365/742] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:29 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:29.566395 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:29.569027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:29.603042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:29.604177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:29.605720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:29.606838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:29.998976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:30.013587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:30.015668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:30.017209 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-451d70a1-a1fe-4ec3-af03-b4a01f01f03e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.466832 May 24 10:06:30.018145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 378/743] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:29 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:30.353099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:30.354315 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:30.363867 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:30.364433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:30.365351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:30.365866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:30.507645 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7c3fe1ce-4919-44f7-a7c5-1d0877e0fba6 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28634 microversion: 2.1 time: 0.160368 May 24 10:06:30.509128 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 366/744] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:30 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28634 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:31.072479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:31.072479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:31.072479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:31.072479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:31.073585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:31.073585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:31.353358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:31.370410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:31.373793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:31.375914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9abaf420-21ac-4ec1-9ffa-ad5c64dfbb51 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.332506 May 24 10:06:31.376767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 379/745] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:31 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:31.530634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:31.534117 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:31.552374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:31.553502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:31.554828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:31.555872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:31.699091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-fb00e5d5-ac5f-403d-83d8-71382b426ef2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28634 microversion: 2.1 time: 0.179532 May 24 10:06:31.700251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 367/746] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:31 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28634 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:32.409420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:32.411893 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:32.426197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:32.427503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:32.429314 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:32.430760 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:32.716325 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:32.718362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:32.731196 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:32.732101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:32.733281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:32.734188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:32.779736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:32.814468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:32.818672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:32.820500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3981f7bc-1ba5-4f20-bcf9-c3e076b22fbb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.420750 May 24 10:06:32.821753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 380/747] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:32 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:32.916724 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4f2cb7b1-cd1b-4cf8-b648-e999469140ee tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 28634 microversion: 2.1 time: 0.199456 May 24 10:06:32.917844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 368/748] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:32 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 28634 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:33.854904 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:33.856462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:33.872343 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:33.873402 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:33.874908 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:33.875689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:33.945189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:33.948041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:33.981579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:33.981838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:33.983299 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:33.984206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:34.242303 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f19cbe06-a2e1-4b87-8081-744ca9e9ee47 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 29502 microversion: 2.1 time: 0.305597 May 24 10:06:34.243524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 369/749] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:33 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 29502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:34.275168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:34.276675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:34.294066 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:34.294912 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:34.296323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:34.297097 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:34.315011 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:34.328008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:34.329944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:34.331328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dbea98a7-cf3a-4066-8805-c974a205d80f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.484270 May 24 10:06:34.332281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 381/750] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:33 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:34.844480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a6af3bd6-7773-46a3-9e9d-0ebf07c084ea tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action" status: 202 len: 0 microversion: 2.1 time: 0.577441 May 24 10:06:34.844480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 370/751] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:34 2021] POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:06:34.864907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:34.864907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:34.889713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:34.890732 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:34.892024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:34.892882 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:35.257358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:35.258430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:35.290821 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:35.291286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:35.293800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:35.294255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:35.361708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:35.377906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-352010d8-79a2-4630-a9a9-09d225e4246f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1750 microversion: 2.1 time: 0.523193 May 24 10:06:35.391501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 382/752] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:34 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1750 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:35.444944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:35.444944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:35.444944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:35.444944 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:35.446120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:35.446120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:35.479157 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-dc159991-ec9b-43f4-8a3e-6b6d092ea718 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 31147 microversion: 2.1 time: 0.225657 May 24 10:06:35.486492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 371/753] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:35 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 31147 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:35.699595 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:35.713698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:35.720016 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:35.722333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b40e7ae0-9edd-4940-b3bf-f6fe239c5744 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.329314 May 24 10:06:35.723384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 383/754] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:35 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:36.404853 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:36.405647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:36.416228 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.417006 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.418103 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.418745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.505972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:36.511455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:36.543610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.544291 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.545327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.545950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.685423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b754c369-ae53-4166-9374-1f81dc2ece99 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 32767 microversion: 2.1 time: 0.183673 May 24 10:06:36.685423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 384/755] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:36 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 32767 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:36.752175 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:36.753815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:36.771228 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.772211 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.773402 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:36.773989 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:36.904284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:36.915879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8baa1fd1-ca6a-46c2-b074-2e993eaf152c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1750 microversion: 2.1 time: 0.518333 May 24 10:06:36.917164 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 372/756] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:36 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1750 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:37.155942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:37.188984 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:37.188984 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:37.189870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e0b7acb9-b1e2-4fbb-9dbb-9e9e0c821d1e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.447222 May 24 10:06:37.191113 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 385/757] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:36 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:37.692902 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:37.695177 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:37.708685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:37.710598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:37.721151 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:37.722400 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:37.929682 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-2d607914-72f5-414f-a276-28403f46a3b2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 33885 microversion: 2.1 time: 0.244694 May 24 10:06:37.930179 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 373/758] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:37 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 33885 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:37.943196 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:37.945096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:37.963228 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:37.965839 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:37.967725 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:37.968653 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:38.221999 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:38.224015 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:38.245486 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:38.247294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:38.248995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:38.249929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:38.330466 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:38.341690 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8287ed40-7f21-4fe4-a3f9-5feb7333512c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.404959 May 24 10:06:38.354217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 386/759] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:37 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:38.607394 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:38.618281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:38.625551 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:38.625551 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-496a4978-11b6-42ad-8240-2ce02edd96a2 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.408384 May 24 10:06:38.634281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 374/760] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:38 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:38.957582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:38.960383 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:38.976824 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:38.978210 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:38.980947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:38.982936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:39.213165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d5147fc4-547a-4da3-a405-ea40c09ede02 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 34803 microversion: 2.1 time: 0.272542 May 24 10:06:39.215755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 387/761] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:38 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 34803 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:39.366937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:39.368903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:39.383294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:39.384648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:39.386412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:39.387927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:39.657855 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:39.659816 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:39.676761 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:39.677748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:39.679356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:39.680381 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:40.011133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:40.023201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:40.029672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:40.030434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:40.031692 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7f52a6f5-325d-430a-bf8c-58430a55dbce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.392500 May 24 10:06:40.032281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 388/762] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:39 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:40.045939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-73203b25-6283-4676-b681-194056e58148 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.686489 May 24 10:06:40.046549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 375/763] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:39 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:40.240720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:40.240720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:40.245302 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:40.246672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:40.247848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:40.248415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:40.356263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-52ecd6c9-9ef5-4252-b043-243c2aa5cbc0 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 35844 microversion: 2.1 time: 0.128287 May 24 10:06:40.356924 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 389/764] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:40 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 35844 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:41.054923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:41.056062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:41.068065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:41.068835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:41.083213 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.083691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.084600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.085074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.095586 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.096055 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.097150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.097613 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.431679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:41.449441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:41.452458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:41.454606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-983b5ed6-ed87-4fd9-9d56-1097bc1aac0e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1740 microversion: 2.20 time: 0.405531 May 24 10:06:41.455590 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 376/765] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:41 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:41.487660 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:41.488700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:41.498367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.498846 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.499052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:41.499728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:41.500222 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:41.510103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-53039de9-9212-4685-9b0f-5f761ff5a3ee tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.448230 May 24 10:06:41.510949 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 390/766] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:41 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:41.622176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f2678f88-8c8d-4336-bff4-baac96be12a1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 37379 microversion: 2.1 time: 0.163770 May 24 10:06:41.622858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 377/767] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:41 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 37379 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:42.501840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:42.506828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:42.528170 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.529165 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:42.530810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.531658 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:42.536827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:42.536827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:42.557708 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.559243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:42.560777 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.561929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:42.863756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:42.875055 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:42.876756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:42.878247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-55fdeb82-da67-4cfc-805f-c28c2f61bb2f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1722 microversion: 2.20 time: 0.386328 May 24 10:06:42.879208 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 391/768] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:42 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:42.888477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:42.890780 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:42.906506 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.907058 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:42.908161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:42.908812 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:43.047303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9ffd5571-b28b-46fd-bf06-e65af5666437 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 38160 microversion: 2.1 time: 0.165557 May 24 10:06:43.049078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 392/769] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:42 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 38160 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:43.092336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:43.110247 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-72e1bfc0-faae-415d-826d-5f8197a1d936 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.584846 May 24 10:06:43.111989 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 378/770] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:42 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:43.913040 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:43.914320 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:43.929979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:43.930812 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:43.932178 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:43.932936 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:44.063836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:44.065099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:44.074803 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:44.075423 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:44.076648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:44.077328 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:44.201236 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:44.201968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-25be5a0b-2018-440e-97de-8d7959ef9c2d tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 38160 microversion: 2.1 time: 0.141682 May 24 10:06:44.209118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 379/771] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:44 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 38160 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:44.212980 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:44.214348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:44.222010 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:44.224979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:44.227150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-11b9686c-b77d-4c16-be7f-2c4d8cdbe7f7 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1722 microversion: 2.20 time: 0.321741 May 24 10:06:44.228475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 393/772] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:43 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:44.228858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:44.229636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:44.231176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:44.231662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:44.455270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:44.466140 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1ef2913f-3447-45ce-8e45-947382d5c8a5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.261225 May 24 10:06:44.466758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 380/773] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:44 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:45.215906 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:45.216959 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:45.225656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.226169 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.227088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.227581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.251513 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:45.253072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:45.267194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.267961 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.269370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.270124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.389443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b2b52abe-485d-4f65-82d2-c7dc22246f0e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 38160 microversion: 2.1 time: 0.178123 May 24 10:06:45.390094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 394/774] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:45 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 38160 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:45.498861 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:45.500248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:45.509791 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.515371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.515371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.515371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.561559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:45.579658 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:45.583215 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:45.585708 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-062f49df-f16b-4cb1-868c-2ab0977347ce tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1722 microversion: 2.20 time: 0.340706 May 24 10:06:45.592844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 381/775] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:45 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:45.834591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-921e95c9-7c17-4dd0-ae19-ea1e24dab13a req-52e39b6c-677f-40b2-b7a0-aa55880d509d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a56d8-d836-470a-b693-994765367aec", "name": "network-vif-unplugged", "status": "completed", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:45.837741 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:45.837741 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:06:45.852034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:45.854593 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-921e95c9-7c17-4dd0-ae19-ea1e24dab13a req-52e39b6c-677f-40b2-b7a0-aa55880d509d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:45.858267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-921e95c9-7c17-4dd0-ae19-ea1e24dab13a req-52e39b6c-677f-40b2-b7a0-aa55880d509d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:45.867651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-81af68f9-77d9-4379-a149-a179ff045834 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.377682 May 24 10:06:45.868971 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 395/776] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:45 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:45.897797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-921e95c9-7c17-4dd0-ae19-ea1e24dab13a req-52e39b6c-677f-40b2-b7a0-aa55880d509d service nova] Creating event network-vif-unplugged:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:06:45.908234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-921e95c9-7c17-4dd0-ae19-ea1e24dab13a req-52e39b6c-677f-40b2-b7a0-aa55880d509d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080455 May 24 10:06:45.909457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 382/777] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:06:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:06:46.401300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:46.402130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:46.410228 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.410679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.411495 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.411972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.541606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-fa9fcd01-6526-46bf-a21a-009c570f0d84 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action" status: 200 len: 38291 microversion: 2.1 time: 0.143442 May 24 10:06:46.542815 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 396/778] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:06:46 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/action => generated 38291 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:46.554734 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:46.558253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:46.565598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.566066 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.567278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.568026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.615298 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:46.616132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:46.625376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.625835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.626652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.627099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.632290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3bd606aa-67aa-43ca-b513-29873790a7e4 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/ips" status: 200 len: 144 microversion: 2.1 time: 0.082386 May 24 10:06:46.639289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 383/779] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:06:46 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/ips => generated 144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:06:46.894259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:46.895035 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:46.904983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.905395 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.906206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.906655 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.942698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:46.963174 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:46.967163 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:46.968811 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7705e0aa-b076-49dd-be0c-e0856035a62f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1665 microversion: 2.20 time: 0.357900 May 24 10:06:46.969746 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 397/780] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:46 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1665 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:46.987085 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd8e4f15-3bdc-4afb-9a2b-784604036e60"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:46.987915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:46.997712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:46.998461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:46.999498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:47.000143 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:47.285436 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:47.295072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-fdd70ebc-c375-45a6-b299-cd5b74cae071 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.404561 May 24 10:06:47.295664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 384/781] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:46 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:48.322342 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:48.323349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:48.333079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.333563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:48.334437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.334884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:48.590194 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:48.599748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d3916d06-c2eb-4b67-a47e-a05dac01f5d3 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.282015 May 24 10:06:48.600512 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 385/782] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:48 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:48.704300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c34e3292-d23d-4c3d-874d-fdac986c7c46 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.721256 May 24 10:06:48.705533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 398/783] 10.222.0.67 () {62 vars in 1364 bytes} [Mon May 24 10:06:46 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-volume_attachments => generated 188 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:48.785012 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d294cb67-61d3-453a-ac6a-89e355db1304"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:48.788400 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:48.802567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.804626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:48.805799 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.806254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:48.920892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:48.921828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:48.933303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.933303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:48.933303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:48.933303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.041155 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-308d0796-f2e6-4f45-839f-0cf6e543e358 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-volume_attachments/fd8e4f15-3bdc-4afb-9a2b-784604036e60" status: 202 len: 0 microversion: 2.20 time: 1.124583 May 24 10:06:50.041854 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 399/784] 10.222.0.67 () {60 vars in 1457 bytes} [Mon May 24 10:06:48 2021] DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/os-volume_attachments/fd8e4f15-3bdc-4afb-9a2b-784604036e60 => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:06:50.049086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:50.052240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:50.064463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.064918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.065747 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.066189 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.292782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:50.302758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7129e9be-7074-4ad5-b351-f4fac0bea312 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.259899 May 24 10:06:50.303347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 400/785] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:50 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:50.307955 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:50.312822 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:50.316775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.317281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.318088 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.318533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.413209 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-54f2a133-f3de-44a2-8e99-77eb397c4d93 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.633253 May 24 10:06:50.414674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 386/786] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:06:48 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments => generated 194 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:50.662909 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6635dafa-4e42-4b4a-9410-745311868e2d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action" status: 202 len: 0 microversion: 2.20 time: 0.358371 May 24 10:06:50.667690 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 401/787] 10.222.0.67 () {62 vars in 1319 bytes} [Mon May 24 10:06:50 2021] POST /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:06:50.674380 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:50.675103 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:50.689510 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.690483 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:50.691731 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:50.692386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:51.215129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:51.225543 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:51.227196 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:51.228627 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b085a6f6-d412-4ba4-ad49-57e355b4b637 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1673 microversion: 2.20 time: 0.558883 May 24 10:06:51.238539 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 387/788] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:50 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1673 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:51.326122 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:51.331262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:51.360797 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:51.362992 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:51.362992 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:51.364208 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:51.933607 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:51.945823 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b25a84c9-1d19-45b2-8fc3-42b90c9feff5 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.627702 May 24 10:06:51.946714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 402/789] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:51 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:52.248334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:52.248987 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:52.257264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:52.257719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:52.258515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:52.258956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:52.486161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:52.499730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:52.501254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:52.502586 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-221a0340-8ad9-424f-82b8-ca76bb24162f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1673 microversion: 2.20 time: 0.258687 May 24 10:06:52.503144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 388/790] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:52 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:52.962799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:52.963529 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:52.972001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:52.972462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:52.973279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:52.973724 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:53.191338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:53.201239 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2c5736c5-8d62-45df-8154-907d45cbf7ec tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.242126 May 24 10:06:53.201821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 403/791] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:52 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:53.521624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:53.522258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:53.530160 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:53.530622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:53.531427 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:53.531877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:53.750258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:53.760362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:53.762179 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:53.763989 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-05d81151-ec45-47eb-b96d-411622138233 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1673 microversion: 2.20 time: 0.246307 May 24 10:06:53.764661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 389/792] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:53 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:54.219522 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:54.220151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:54.228365 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:54.228819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:54.229656 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:54.230103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:54.443828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:54.455377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8c850233-f154-42f0-b52a-9538ed0e3280 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.239327 May 24 10:06:54.456249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 404/793] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:54 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:54.787368 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:54.788532 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:54.803386 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:54.804121 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:54.805623 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:54.806810 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:55.089373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:55.099544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:55.101129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:55.102325 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9003e2e2-f9d6-467a-9977-fe1731b794f9 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1675 microversion: 2.20 time: 0.322358 May 24 10:06:55.102889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 390/794] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:54 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1675 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:55.473909 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:55.474765 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:55.485004 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:55.485498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:55.486808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:55.486808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:55.733810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:55.748879 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-365c3dd4-1799-4116-aeb0-9e08c53538f9 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1755 microversion: 2.1 time: 0.279207 May 24 10:06:55.749995 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 405/795] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:55 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:56.125373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:56.126215 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:56.134731 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:56.135321 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:56.136244 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:56.136801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:56.511020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:56.528672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:56.531814 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:56.533702 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-77902fae-e948-4b7b-9a48-9b1cad09be6e tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.412800 May 24 10:06:56.534576 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 391/796] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:56 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:56.767199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:56.767827 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:56.775919 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:56.776382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:56.777253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:56.777704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:57.003362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:57.016283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-846955a0-a650-475b-913f-d2c162bf2fd1 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1758 microversion: 2.1 time: 0.253023 May 24 10:06:57.016892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 406/797] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:06:56 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:57.562656 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:57.564074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:57.581092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:57.581092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:57.581092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:57.581092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:57.880737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:57.891807 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:57.893419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:57.894637 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9bbe7f0b-1698-4684-9092-1c5f7be61fe8 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.337855 May 24 10:06:57.895244 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 392/798] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:57 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:06:58.636151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-582309062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-899814628", "security_groups": [{"name": "tempest-secgroup-smoke-222702199"}], "networks": [{"uuid": "9a3ab75c-0613-43fc-b406-9209bc3e8724"}], "block_device_mapping_v2": [{"uuid": "b4aa99e3-41ee-4f1e-9543-f3f346d89d56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:58.916656 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:58.918940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:06:58.927805 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:58.928616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:58.929740 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:58.930415 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:59.066776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] validate_networks() for [('9a3ab75c-0613-43fc-b406-9209bc3e8724', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:06:59.235237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:59.247295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:59.249427 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:06:59.251083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b52288c2-b7bf-4764-8f84-ac9b009fda05 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.339417 May 24 10:06:59.261915 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 393/799] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:06:58 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:59.928929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:06:59.930768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:06:59.932588 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:06:59.934472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:06:59.936022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:06:59.956249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:59.957184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:59.958748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:06:59.959651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:06:59.995012 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for project ce96e2adbf10489aae7640c84f398b29. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:07:00.002302 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Getting quotas for user 76d89f739ff940bc835dbe914ebc7043 and project ce96e2adbf10489aae7640c84f398b29. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:07:00.186084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:07:00.189618 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4aa99e3-41ee-4f1e-9543-f3f346d89d56',volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:07:00.272873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:00.274312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:00.284301 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:00.284911 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:00.285860 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:00.286410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:00.583908 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:00.596606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:00.598253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:00.599431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7a05323c-f4b1-41ed-93b2-98b4709b621a tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.331103 May 24 10:07:00.610763 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 394/800] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:00 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:00.758536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2bf4c91a-70e7-4720-8510-468982cbc594 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.130004 May 24 10:07:00.760093 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 407/801] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:06:58 2021] POST /compute/v2.1/servers => generated 405 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:07:00.771636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4e7b77ef-bddb-4644-97a8-6f4a4fbcfbfe tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:00.772600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4e7b77ef-bddb-4644-97a8-6f4a4fbcfbfe tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:00.983818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4e7b77ef-bddb-4644-97a8-6f4a4fbcfbfe tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:00.997729 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4e7b77ef-bddb-4644-97a8-6f4a4fbcfbfe tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1087 microversion: 2.1 time: 0.229841 May 24 10:07:00.999118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 395/802] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:00 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1087 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:01.620112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:01.621108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:01.641417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:01.648048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:01.650567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:01.651476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:01.946716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:01.970103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:01.973448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:01.975715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7ba0330f-eb91-4963-8cd3-f050c6127ae1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.360517 May 24 10:07:01.976809 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 408/803] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:01 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:02.025425 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-827990bf-48fd-4827-b9d4-9cbd966d3382 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:02.027297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-827990bf-48fd-4827-b9d4-9cbd966d3382 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:02.116272 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-827990bf-48fd-4827-b9d4-9cbd966d3382 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:02.129528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-827990bf-48fd-4827-b9d4-9cbd966d3382 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1087 microversion: 2.1 time: 0.113803 May 24 10:07:02.130170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 396/804] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:02 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1087 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:02.999933 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:03.001107 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:03.009389 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:03.009914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:03.010729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:03.011177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:03.149930 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:03.150926 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:03.164249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:03.165523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:03.175510 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:03.176332 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:03.329548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:03.353306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:03.356704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:03.358790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-abe343d8-4c35-4591-8814-5a0a8a5f821b tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.362988 May 24 10:07:03.488563 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 409/805] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:02 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:03.489921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:03.489921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c0217edd-897c-46df-aeb4-1e2e5ddbc416 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.297831 May 24 10:07:03.489921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 397/806] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:03 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:04.402403 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:04.404698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:04.412782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:04.413671 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:04.414295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:04.415062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:04.476294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:04.478168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:04.507643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:04.508709 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:04.510662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:04.513023 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:04.792877 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:04.812239 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:04.815243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:04.819374 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:04.821386 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-735f134f-c6e7-4729-b88b-846cebb4e32f tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.432009 May 24 10:07:04.823401 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 410/807] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:04 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:04.827165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-10147a78-f18f-4e10-bd5b-c11ee26d7f66 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.360747 May 24 10:07:04.841185 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 398/808] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:04 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:05.852514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:05.853587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:05.854284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:05.854480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:05.862350 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:05.862668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:05.862859 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:05.863200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:05.863621 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:05.864034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:05.864207 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:05.864562 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:06.070465 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:06.085165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3f0ff5aa-635f-441f-8049-56547bb10f52 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.232195 May 24 10:07:06.085165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 399/809] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:05 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:06.421317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:06.439914 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:06.441469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:06.442739 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4a2fbd1c-d00c-41ea-bb26-c6489cd62b47 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.594067 May 24 10:07:06.444037 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 411/810] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:05 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:07.104518 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:07.106524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:07.115457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:07.116008 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:07.118525 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:07.119779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:07.250501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:07.268548 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e8843e17-4cca-4bb1-9e90-090fb9249781 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.168258 May 24 10:07:07.279317 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 400/811] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:07 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:07.462799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:07.494868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:07.494868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:07.494868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:07.494868 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:07.495307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:07.732089 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:07.742493 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:07.744007 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:07.745182 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0431b5b0-ebb3-4dde-90e7-7836766ce649 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.286442 May 24 10:07:07.745856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 412/812] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:07 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:08.290535 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:08.292025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:08.304267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:08.305449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:08.306913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:08.307662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:08.531798 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:08.560305 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f1a7e025-5f87-4a64-a365-719cc260fc51 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.267704 May 24 10:07:08.560305 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 401/813] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:08 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:08.770028 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:08.771447 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:08.784664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:08.785483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:08.787003 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:08.787779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:09.047331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:09.057896 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:09.060800 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:09.060800 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0798a4de-37a4-4591-8a89-3239dd8a5cd0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.298782 May 24 10:07:09.061264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 413/814] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:08 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:09.568527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:09.569188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:09.578058 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:09.578506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:09.579308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:09.579750 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:09.712442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:09.720952 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1aa6e92f-cbde-4406-9522-f4bcd8a3d0e4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1137 microversion: 2.1 time: 0.156276 May 24 10:07:09.721568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 402/815] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:09 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1137 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:10.081787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:10.083687 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:10.096216 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:10.096979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:10.098332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:10.099091 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:10.395000 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:10.413401 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:10.416696 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:10.419606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cfdd6184-1f5b-4ee7-91e8-9f20a0d8f746 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.342309 May 24 10:07:10.422918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 414/816] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:10 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:10.747002 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:10.747800 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:10.755769 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:10.756363 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:10.757302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:10.757754 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:10.885668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:10.900604 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-05bfb032-457c-450e-a3bf-41d35cbb908f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1185 microversion: 2.1 time: 0.157579 May 24 10:07:10.901490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 403/817] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:10 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:11.449564 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:11.450414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:11.459380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.460120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.461307 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.461870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.701750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:11.711670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:11.713498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:11.714801 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-61c75bf2-90fb-49c9-ad28-74b960707134 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.269779 May 24 10:07:11.715382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 415/818] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:11 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:11.852718 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:11.853759 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:11.862368 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.862822 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.863628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.864072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.928134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:11.928937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:11.938094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.938548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.938858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c89f1e88-3518-40e7-9fd6-038379bb7210 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090061 May 24 10:07:11.939356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.939799 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.939945 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 404/819] 10.222.0.67 () {58 vars in 1302 bytes} [Mon May 24 10:07:11 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:11.950592 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:11.951020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:11.958791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.959234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:11.960034 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:11.960477 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:12.033628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-353f438f-0ccf-4738-9983-09392eb6f669 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304" status: 200 len: 194 microversion: 2.1 time: 0.087568 May 24 10:07:12.034253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 405/820] 10.222.0.67 () {58 vars in 1413 bytes} [Mon May 24 10:07:11 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:07:12.075737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:12.085303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-71461933-6486-421e-9e0d-8be898641e5c tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1193 microversion: 2.1 time: 0.161133 May 24 10:07:12.086172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 416/821] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:11 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:12.743972 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:12.749709 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:12.763942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:12.764834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:12.766420 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:12.767288 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:13.063808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:13.085573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:13.088772 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:13.091659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3c32894f-30b1-40e1-b0ab-a4b4eec3c054 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.356270 May 24 10:07:13.092691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 406/822] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:12 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:13.103707 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:13.110247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:13.112737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:13.113237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:13.114048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:13.114645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:13.273283 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:13.282797 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0591f837-f67b-421f-99a6-c262eb5104ac tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1193 microversion: 2.1 time: 0.183116 May 24 10:07:13.283464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 417/823] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:13 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1193 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:14.123751 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:14.124667 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:14.139267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:14.141880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:14.141880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:14.142534 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:14.301582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:14.304071 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:14.316462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:14.317329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:14.318434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:14.318745 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:14.468715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:14.480507 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3c55d784-8bd0-4a00-ad22-df412f8ffad4 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1203 microversion: 2.1 time: 0.183481 May 24 10:07:14.481847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 418/824] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:14 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:14.659859 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:14.677803 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:14.680710 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:14.683131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-45240006-d8c1-4007-86df-7be767bddaf0 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.566217 May 24 10:07:14.684157 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 407/825] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:14 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:15.213647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7d5367f-971d-4509-a45b-5e2166f78eeb"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:15.215951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:15.231247 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:15.231998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:15.233531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:15.234369 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:15.505790 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:15.507331 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:15.522146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:15.522606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:15.523466 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:15.523852 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:16.230281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:16.240114 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-52bbfc43-e8f0-4db1-9433-19e8308f922f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1270 microversion: 2.1 time: 0.744544 May 24 10:07:16.240693 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 408/826] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:15 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1270 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:16.252358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:16.253965 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:16.264025 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:16.264877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:16.265817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:16.266414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:16.399698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-db2954dd-0f28-4e7c-b78e-87b7791712ff tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193608 May 24 10:07:16.401673 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 419/827] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:07:15 2021] POST /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments => generated 194 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:16.406707 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-ba459aba-1887-4d1a-9081-e619cb2752e3 req-a26fa980-7221-4ef8-a9b2-d8a147619363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a56d8-d836-470a-b693-994765367aec", "name": "network-vif-plugged", "status": "completed", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:16.408315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:16.408315 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:07:16.434051 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ba459aba-1887-4d1a-9081-e619cb2752e3 req-a26fa980-7221-4ef8-a9b2-d8a147619363 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:16.435931 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ba459aba-1887-4d1a-9081-e619cb2752e3 req-a26fa980-7221-4ef8-a9b2-d8a147619363 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:16.483952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-ba459aba-1887-4d1a-9081-e619cb2752e3 req-a26fa980-7221-4ef8-a9b2-d8a147619363 service nova] Creating event network-vif-plugged:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:07:16.494107 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-ba459aba-1887-4d1a-9081-e619cb2752e3 req-a26fa980-7221-4ef8-a9b2-d8a147619363 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091493 May 24 10:07:16.495406 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 420/828] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:16.606923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:16.617348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:16.618941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:16.620172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-95bb5e41-c268-4dc3-806d-d25f05b56414 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.378234 May 24 10:07:16.620698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 409/829] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:16 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:17.263964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:17.264688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:17.273331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:17.273779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:17.274589 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:17.275040 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:17.503659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-f9effe85-ea66-4c07-8647-ea07910f2cd3 req-c23a981c-d7a2-4848-a3ed-f93340093ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:17.510031 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:17.511620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:17.511620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:17.528280 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8ba9347b-e9e3-4073-8580-68ebaea9e969 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.268720 May 24 10:07:17.533611 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 421/830] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:17 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:17.572051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f9effe85-ea66-4c07-8647-ea07910f2cd3 req-c23a981c-d7a2-4848-a3ed-f93340093ed1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:17.572051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f9effe85-ea66-4c07-8647-ea07910f2cd3 req-c23a981c-d7a2-4848-a3ed-f93340093ed1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:17.634595 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-f9effe85-ea66-4c07-8647-ea07910f2cd3 req-c23a981c-d7a2-4848-a3ed-f93340093ed1 service nova] Creating event network-changed:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:07:17.649131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-f9effe85-ea66-4c07-8647-ea07910f2cd3 req-c23a981c-d7a2-4848-a3ed-f93340093ed1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167745 May 24 10:07:17.651093 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 410/831] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:17.651948 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:17.655500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:17.686300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:17.686300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:17.686300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:17.686300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:17.937267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:17.948204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:17.950345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:17.951567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ccc2575a-a811-4a46-a672-5f460e696464 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.308060 May 24 10:07:17.953267 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 422/832] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:17 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:18.566488 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:18.568028 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:18.593948 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:18.595262 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:18.596867 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:18.597577 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:18.977241 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:18.977241 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:18.988279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:18.988866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:18.990040 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:18.990602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:19.047481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:19.056998 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c24d6eb5-5f72-44b2-8dcc-43fbd8be242b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.502385 May 24 10:07:19.067043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 411/833] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:18 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:19.285767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:19.313349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:19.333581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:19.336083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-292a76e4-9694-4bcf-827d-75b38e656e5d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.369625 May 24 10:07:19.349404 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 423/834] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:18 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:20.074453 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:20.075298 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:20.083213 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:20.083887 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:20.084834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:20.085365 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:20.347985 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:20.360157 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8dd25a81-1143-4d2f-a102-d30c4f1a5cd3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.289350 May 24 10:07:20.361161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 412/835] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:20 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:20.361979 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:20.363204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:20.379068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:20.380060 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:20.381602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:20.382409 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:20.627844 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:20.637954 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:20.640755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:20.642976 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3054c627-17f0-4e41-8b83-2f834489df31 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1731 microversion: 2.20 time: 0.288136 May 24 10:07:20.644049 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 424/836] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:20 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:21.379999 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:21.380651 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:21.388795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:21.389284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:21.390077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:21.390517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:21.610595 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:21.619383 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-99c10752-1cbe-442e-a252-c773ac7506df tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.243184 May 24 10:07:21.619958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 413/837] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:21 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:21.672704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:21.672704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:21.677376 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:21.678025 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:21.679150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:21.679729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:21.902533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:21.912130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:21.913714 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:21.915174 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d1ccd338-c35e-44b0-b26d-692b48345382 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1718 microversion: 2.20 time: 0.251856 May 24 10:07:21.915760 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 425/838] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:21 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1718 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:22.636308 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:22.637788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:22.645596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:22.646175 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:22.646982 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:22.647511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:22.863628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:22.874051 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-01b66f71-62f9-461d-a5e9-27deec257031 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.241375 May 24 10:07:22.874634 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 414/839] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:22 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:23.892326 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.893024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:23.901706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:23.902161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:23.903500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:23.903942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:24.166060 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:24.176008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-68a3416d-d871-4e85-850f-11368d49a0c1 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.287943 May 24 10:07:24.176624 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 426/840] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:23 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:24.497427 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.499110 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:24.513463 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:24.514264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:24.515695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:24.516505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:24.642616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7153c6aa-e622-452e-bcd0-f45735939137 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.153367 May 24 10:07:24.643384 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 415/841] 10.222.0.67 () {58 vars in 1302 bytes} [Mon May 24 10:07:24 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments => generated 371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:24.904610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.905284 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:24.913129 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:24.913596 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:24.914681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:24.915123 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:24.990299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5b54976b-f88c-43d1-b066-829cbe5fef30 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304" status: 200 len: 194 microversion: 2.1 time: 0.089538 May 24 10:07:24.990921 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 427/842] 10.222.0.67 () {58 vars in 1413 bytes} [Mon May 24 10:07:24 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:25.005302 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:25.006254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:25.020936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:25.021862 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:25.023341 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:25.024148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:25.198590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:25.200005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:25.215093 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:25.216082 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:25.217620 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:25.218468 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:25.340732 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lazy-loading 'services' on Instance uuid 91e8cab0-6add-4148-873b-9f1564abc530 {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:25.554183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:25.571102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b9590e6b-e792-4046-b09e-38e4d8e6beb3 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.379436 May 24 10:07:25.572173 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 428/843] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:25 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:25.674968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-83e211b7-0422-4de8-a6fd-0c5813552e80 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304" status: 202 len: 0 microversion: 2.1 time: 0.676727 May 24 10:07:25.675692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 416/844] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:07:24 2021] DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d294cb67-61d3-453a-ac6a-89e355db1304 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:07:26.597400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:26.598133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:26.606539 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:26.607180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:26.607986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:26.610870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:26.840790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:26.852480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5e8c25f6-8b86-4692-951d-dfe3b672c10a tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.258930 May 24 10:07:26.852968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 429/845] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:26 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:27.870522 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:27.871767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:27.879895 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:27.880464 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:27.881397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:27.881970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.064352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:28.065026 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:28.072950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:28.073560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.074433 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:28.074881 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.176567 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c2944f97-29bc-4b94-8e57-b645c5a167e1 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d7d5367f-971d-4509-a45b-5e2166f78eeb" status: 200 len: 194 microversion: 2.1 time: 0.115661 May 24 10:07:28.177793 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 430/846] 10.222.0.67 () {58 vars in 1413 bytes} [Mon May 24 10:07:28 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d7d5367f-971d-4509-a45b-5e2166f78eeb => generated 194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:07:28.190206 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:28.191191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:28.202053 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:28.202874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.203858 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:28.204595 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.211115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:28.228435 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f59a00ec-ff9c-44b4-b952-25f2be9d20d0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.361813 May 24 10:07:28.233962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 417/847] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:27 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:28.353529 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-bf54f623-64c0-4317-9137-27673afd1af8 req-b6705b9f-5bdd-4e41-8e8a-24d892308676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "name": "network-vif-plugged", "status": "completed", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:28.357471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:28.357471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:28.371957 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-bf54f623-64c0-4317-9137-27673afd1af8 req-b6705b9f-5bdd-4e41-8e8a-24d892308676 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:28.372655 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-bf54f623-64c0-4317-9137-27673afd1af8 req-b6705b9f-5bdd-4e41-8e8a-24d892308676 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:28.397892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-bf54f623-64c0-4317-9137-27673afd1af8 req-b6705b9f-5bdd-4e41-8e8a-24d892308676 service nova] Creating event network-vif-plugged:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:07:28.404958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-bf54f623-64c0-4317-9137-27673afd1af8 req-b6705b9f-5bdd-4e41-8e8a-24d892308676 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059354 May 24 10:07:28.405608 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 418/848] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:07:28.413513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lazy-loading 'services' on Instance uuid 91e8cab0-6add-4148-873b-9f1564abc530 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:28.748472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a0f32747-58ae-4fc9-b490-a46a20caa44b tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d7d5367f-971d-4509-a45b-5e2166f78eeb" status: 202 len: 0 microversion: 2.1 time: 0.563182 May 24 10:07:28.749176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 431/849] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:07:28 2021] DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530/os-volume_attachments/d7d5367f-971d-4509-a45b-5e2166f78eeb => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:07:29.255932 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:29.256657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:29.265617 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:29.266068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:29.266872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:29.267337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:29.491007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:29.501502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f421e7b6-d081-4fcf-9f3b-b72a586d3392 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1258 microversion: 2.1 time: 0.249607 May 24 10:07:29.505285 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 419/850] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:29 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1258 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:30.519728 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:30.520413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:30.528560 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:30.529079 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:30.529905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:30.530354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:30.743792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:30.760875 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-72259faf-418a-4c92-8070-60dbd4d0fd70 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1442 microversion: 2.1 time: 0.244918 May 24 10:07:30.762757 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 432/851] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:30 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1442 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:30.787624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:30.788259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:30.796406 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:30.796865 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:30.797743 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:30.798283 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:31.013986 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:31.029426 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ea5229ad-9168-463b-8462-e8980b0cc0bd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1442 microversion: 2.1 time: 0.245090 May 24 10:07:31.030490 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 420/852] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:30 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1442 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:31.543895 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:31.544498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:31.552767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:31.553268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:31.560698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:31.560698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:31.621175 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:07:31.949559 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-288e7b8b-6410-457b-b543-b6bb9354b023 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 204 len: 0 microversion: 2.1 time: 0.409741 May 24 10:07:31.950724 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 433/853] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:07:31 2021] DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:07:31.959036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:31.959676 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:31.969376 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:31.969838 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:31.970700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:31.971339 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:32.344392 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:32.358450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-36cf8b59-486a-4166-b4b2-b8aa50de24fe tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1671 microversion: 2.1 time: 0.401402 May 24 10:07:32.359145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 421/854] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:31 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1671 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:33.380701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:33.382355 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:33.390600 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:33.391070 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:33.391917 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:33.392373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:33.704716 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:33.724754 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7be8ef2c-0964-40fd-8b42-fbe663b60159 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1671 microversion: 2.1 time: 0.348393 May 24 10:07:33.726054 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 434/855] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:33 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1671 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:34.756312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:34.757699 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:34.772820 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:34.773722 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:34.775238 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:34.776071 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:35.528817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:35.539919 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8b95e68d-01be-41eb-bfdd-15351e5a1682 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1671 microversion: 2.1 time: 0.790825 May 24 10:07:35.551779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 422/856] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:34 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1671 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:35.599446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-205366445"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:35.601787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:35.612584 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:35.613039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:35.613912 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:35.614367 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:35.674454 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-f480d267-f7a8-46d5-be1a-40b3da3460de req-19033268-f08a-43e1-b288-227570f357e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:35.677278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:35.677278 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:35.696218 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f480d267-f7a8-46d5-be1a-40b3da3460de req-19033268-f08a-43e1-b288-227570f357e3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:35.705221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-f480d267-f7a8-46d5-be1a-40b3da3460de req-19033268-f08a-43e1-b288-227570f357e3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:35.736998 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-f480d267-f7a8-46d5-be1a-40b3da3460de req-19033268-f08a-43e1-b288-227570f357e3 service nova] Creating event network-changed:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:07:35.747672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-f480d267-f7a8-46d5-be1a-40b3da3460de req-19033268-f08a-43e1-b288-227570f357e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078417 May 24 10:07:35.751526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 423/857] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:07:35.963503 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.network.security_group_api [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Removing security group 74db5aed-164a-4d86-968e-bc83de180d04 from port fb9be3d2-4022-41e3-825a-ddf6079de0ba May 24 10:07:36.559667 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:36.560389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:36.569200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:36.571431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:36.571431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:36.571431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:36.987234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:36.997199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-91581dc1-95b0-4e7e-a225-857a6ddb086e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1604 microversion: 2.1 time: 0.441849 May 24 10:07:37.008970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 424/858] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:36 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1604 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:37.238792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b6a1847b-9219-45f8-bc2c-0f8b587a6974 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action" status: 202 len: 0 microversion: 2.1 time: 1.644469 May 24 10:07:37.240389 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 435/859] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:07:35 2021] POST /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/action => generated 0 bytes in 1647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:07:37.258063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-34abb223-025c-4cd2-8f9f-d0a83e110dfe req-fc0cfa78-eb37-47e8-badf-542297c6d54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:37.260200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:37.260200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:37.274853 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-34abb223-025c-4cd2-8f9f-d0a83e110dfe req-fc0cfa78-eb37-47e8-badf-542297c6d54f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:37.278519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-34abb223-025c-4cd2-8f9f-d0a83e110dfe req-fc0cfa78-eb37-47e8-badf-542297c6d54f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:37.318311 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-34abb223-025c-4cd2-8f9f-d0a83e110dfe req-fc0cfa78-eb37-47e8-badf-542297c6d54f service nova] Creating event network-changed:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:07:37.335131 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-34abb223-025c-4cd2-8f9f-d0a83e110dfe req-fc0cfa78-eb37-47e8-badf-542297c6d54f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080717 May 24 10:07:37.336439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 425/860] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:37.826184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-2473806f-70c2-4f27-87fb-f2c999a57463 req-53cda26a-62b7-42b0-a432-f0559cdfaa61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e8cab0-6add-4148-873b-9f1564abc530", "name": "network-vif-deleted", "tag": "08d1ba31-f09e-4772-a2c3-16a65ba1761c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:37.845686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:37.845686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:07:37.877201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-2473806f-70c2-4f27-87fb-f2c999a57463 req-53cda26a-62b7-42b0-a432-f0559cdfaa61 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:37.878685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-2473806f-70c2-4f27-87fb-f2c999a57463 req-53cda26a-62b7-42b0-a432-f0559cdfaa61 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:37.947166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-2473806f-70c2-4f27-87fb-f2c999a57463 req-53cda26a-62b7-42b0-a432-f0559cdfaa61 service nova] Creating event network-vif-deleted:08d1ba31-f09e-4772-a2c3-16a65ba1761c for instance 91e8cab0-6add-4148-873b-9f1564abc530 on hv-cinder-79123 May 24 10:07:37.954100 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-2473806f-70c2-4f27-87fb-f2c999a57463 req-53cda26a-62b7-42b0-a432-f0559cdfaa61 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135825 May 24 10:07:37.956613 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 436/861] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:38.022188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:38.025074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:38.042535 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:38.043430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:38.044923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:38.046091 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:38.222149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:38.223904 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:38.225286 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lazy-loading 'fault' on Instance uuid 91e8cab0-6add-4148-873b-9f1564abc530 {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:38.353358 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e63eef5f9546018134fe3cee5da1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91ad6930924a8d81ee21ec1c490828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:38.370399 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-46fc637a-1b1e-4eef-b9e2-685db5d3b823 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 200 len: 1327 microversion: 2.1 time: 0.356299 May 24 10:07:38.372030 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 426/862] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:38 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 1327 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:39.392991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:39.394176 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:39.403490 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:39.404296 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:39.405740 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:39.406571 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:39.523484 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. May 24 10:07:39.524185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:39.525851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dfa476b7-0815-4635-8c49-1e848e10fef5 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 404 len: 111 microversion: 2.1 time: 0.139066 May 24 10:07:39.526866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 437/863] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:39 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:07:39.539949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0a1ca79e-a286-4b12-b03e-84779a544086 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '.version_select at 0x7f0a38468040>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:39.672730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0a1ca79e-a286-4b12-b03e-84779a544086 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450976120" status: 202 len: 0 microversion: 2.1 time: 0.138909 May 24 10:07:39.673696 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 427/864] 10.222.0.67 () {58 vars in 1218 bytes} [Mon May 24 10:07:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450976120 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:07:40.320137 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:40.325920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:40.326243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-01b872cb-8c34-493c-9e15-6de9759557ba req-545c1dd2-c493-4e7e-a61b-dbe8ca364d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:40.329517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:40.329517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:40.340095 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-01b872cb-8c34-493c-9e15-6de9759557ba req-545c1dd2-c493-4e7e-a61b-dbe8ca364d4d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:40.340929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-01b872cb-8c34-493c-9e15-6de9759557ba req-545c1dd2-c493-4e7e-a61b-dbe8ca364d4d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:40.344199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:40.344790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:40.345782 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:40.346524 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:40.362683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-01b872cb-8c34-493c-9e15-6de9759557ba req-545c1dd2-c493-4e7e-a61b-dbe8ca364d4d service nova] Creating event network-changed:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:07:40.368106 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-01b872cb-8c34-493c-9e15-6de9759557ba req-545c1dd2-c493-4e7e-a61b-dbe8ca364d4d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046146 May 24 10:07:40.369340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 428/865] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:40.628389 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lazy-loading 'services' on Instance uuid 354f2aa8-dfb0-4ea5-8240-67197c5b4362 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:41.008715 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-50fc20fd-cfa9-4d10-855c-1918757abbf2 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments/a78cdab9-0f94-473e-b606-26cbff39b40e" status: 202 len: 0 microversion: 2.1 time: 0.692484 May 24 10:07:41.010450 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 438/866] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:07:40 2021] DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments/a78cdab9-0f94-473e-b606-26cbff39b40e => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:07:41.045659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:41.048459 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:41.067412 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:41.068346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:41.070205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:41.071398 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:41.188996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6d603c7d-89c2-40f1-ae7d-60422f5fc548 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171684 May 24 10:07:41.190675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 429/867] 10.222.0.67 () {58 vars in 1302 bytes} [Mon May 24 10:07:41 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:42.208061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:42.208935 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:42.218708 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:42.219178 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:42.220064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:42.220571 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:42.295475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bbf9ee85-968b-43b6-be4c-3a582472270e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094162 May 24 10:07:42.296497 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 439/868] 10.222.0.67 () {58 vars in 1302 bytes} [Mon May 24 10:07:42 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:43.307567 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:43.309033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:43.317598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:43.318056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:43.318926 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:43.319325 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:43.389714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e1feac23-80f1-41b2-9463-7222ad43f656 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085913 May 24 10:07:43.390227 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 430/869] 10.222.0.67 () {58 vars in 1302 bytes} [Mon May 24 10:07:43 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:07:43.400339 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:43.401001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:43.410087 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:43.410623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:43.411463 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:43.412049 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:43.622175 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] HTTP exception thrown: Instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 is not attached to volume a78cdab9-0f94-473e-b606-26cbff39b40e May 24 10:07:43.623282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Returning 404 to user: Instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 is not attached to volume a78cdab9-0f94-473e-b606-26cbff39b40e {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:43.624865 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d9570532-037b-4cbf-92bc-f2a480bd7a67 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments/a78cdab9-0f94-473e-b606-26cbff39b40e" status: 404 len: 154 microversion: 2.1 time: 0.228317 May 24 10:07:43.626009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 440/870] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:07:43 2021] DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362/os-volume_attachments/a78cdab9-0f94-473e-b606-26cbff39b40e => generated 154 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:07:45.150088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:45.150735 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:45.159719 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.160174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.160974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.161458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.208846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:45.209803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:45.224587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.225496 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.227027 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.227205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:07:45.227886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.329563 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. May 24 10:07:45.330295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:45.331201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8435b5ba-e2ef-421d-adaa-e9b0b0a8c71a tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 404 len: 111 microversion: 2.1 time: 0.129911 May 24 10:07:45.331789 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 441/871] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:07:45 2021] DELETE /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:07:45.347579 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:45.348301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: 91e8cab0-6add-4148-873b-9f1564abc530] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:45.357373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.357908 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.358769 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.359252 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.415349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. May 24 10:07:45.416077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance 91e8cab0-6add-4148-873b-9f1564abc530 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:45.417084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-42c6a903-27f0-4821-b8a5-f681a2f7d600 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530" status: 404 len: 111 microversion: 2.1 time: 0.073487 May 24 10:07:45.418023 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 442/872] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:45 2021] GET /compute/v2.1/servers/91e8cab0-6add-4148-873b-9f1564abc530 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:07:45.629927 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5890cfb6-ec92-4dc0-9a72-89d52df0b601 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 204 len: 0 microversion: 2.1 time: 0.482696 May 24 10:07:45.630259 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 431/873] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:07:45 2021] DELETE /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:07:45.640877 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:45.641653 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:45.649942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.650398 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:45.651199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:45.651639 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:46.001067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:46.009803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8bfaca16-ae5a-4f20-9495-785469031a8c tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1554 microversion: 2.1 time: 0.374363 May 24 10:07:46.015261 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 443/874] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:45 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:46.877748 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:46.878413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:46.886067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:46.887149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:46.888010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:46.888519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:46.941013 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. May 24 10:07:46.941654 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:46.942503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b8aeff10-7c52-4c8f-b66e-54fe5d15cb5e tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 404 len: 111 microversion: 2.1 time: 0.069041 May 24 10:07:46.943063 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 432/875] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:07:46 2021] DELETE /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:07:46.951739 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:46.952345 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] [instance: b5b44b45-4a2f-48d5-851a-222d48691c7e] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:46.959926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:46.960377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:46.961203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:46.961642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:47.015490 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] HTTP exception thrown: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. May 24 10:07:47.016105 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] Returning 404 to user: Instance b5b44b45-4a2f-48d5-851a-222d48691c7e could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:47.016949 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7687f636-b8d2-452c-a6a7-b9f7584a96c2 tempest-AttachVolumeTestJSON-882843242 tempest-AttachVolumeTestJSON-882843242-project] 10.222.0.67 "GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e" status: 404 len: 111 microversion: 2.1 time: 0.069638 May 24 10:07:47.017554 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 444/876] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:46 2021] GET /compute/v2.1/servers/b5b44b45-4a2f-48d5-851a-222d48691c7e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:07:47.028092 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:47.028728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:47.036911 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:47.037409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:47.038222 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:47.038669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:47.531528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:47.547344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5c6b28cf-52b2-4fb1-b8d9-55673305e4bd tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1554 microversion: 2.1 time: 0.523279 May 24 10:07:47.548245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 433/877] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:47 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1554 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:07:48.566428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:48.567453 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:48.584408 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:48.585019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:48.586149 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:48.586705 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:48.885487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:48.895391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ea96d5c9-5d9f-42af-b942-5b78b4d6215f tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1554 microversion: 2.1 time: 0.332787 May 24 10:07:48.896197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 445/878] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:48 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1554 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:49.183549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-0ff06cfb-2735-4919-870c-7ec65d7bcc88 req-129d7863-fb59-4cb4-b7d6-4432d45e4bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354f2aa8-dfb0-4ea5-8240-67197c5b4362", "name": "network-vif-deleted", "tag": "fb9be3d2-4022-41e3-825a-ddf6079de0ba"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:49.186928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:49.186928 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:49.203309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-0ff06cfb-2735-4919-870c-7ec65d7bcc88 req-129d7863-fb59-4cb4-b7d6-4432d45e4bff service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:49.204132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-0ff06cfb-2735-4919-870c-7ec65d7bcc88 req-129d7863-fb59-4cb4-b7d6-4432d45e4bff service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:49.238625 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-0ff06cfb-2735-4919-870c-7ec65d7bcc88 req-129d7863-fb59-4cb4-b7d6-4432d45e4bff service nova] Creating event network-vif-deleted:fb9be3d2-4022-41e3-825a-ddf6079de0ba for instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 on hv-cinder-79123 May 24 10:07:49.247846 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-0ff06cfb-2735-4919-870c-7ec65d7bcc88 req-129d7863-fb59-4cb4-b7d6-4432d45e4bff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071446 May 24 10:07:49.248998 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 434/879] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:49.926275 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:49.927323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:49.941925 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:49.942885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:49.943904 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:49.944473 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:50.058758 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:50.059499 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:50.060377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lazy-loading 'fault' on Instance uuid 354f2aa8-dfb0-4ea5-8240-67197c5b4362 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:50.243929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf90f5b136f24a9c9c5de73a7eda3e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b47c7cc67c545eab92ea86cde1abac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:50.258342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f36b949f-5666-4308-8d5f-6feffd190b78 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 200 len: 1348 microversion: 2.1 time: 0.339263 May 24 10:07:50.259097 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 446/880] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:49 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 1348 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:51.298165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:51.298165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] [instance: 354f2aa8-dfb0-4ea5-8240-67197c5b4362] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:51.316494 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:51.317324 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:51.318789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:51.319605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:51.430903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] HTTP exception thrown: Instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 could not be found. May 24 10:07:51.432040 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Returning 404 to user: Instance 354f2aa8-dfb0-4ea5-8240-67197c5b4362 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:07:51.434522 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-49633a77-9a9a-4217-91de-3dd794b1f72e tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362" status: 404 len: 111 microversion: 2.1 time: 0.147282 May 24 10:07:51.434883 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 435/881] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:07:51 2021] GET /compute/v2.1/servers/354f2aa8-dfb0-4ea5-8240-67197c5b4362 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:07:51.445248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cf683a6b-08c6-4e68-8dcf-bda0937d2929 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] Calling method '.version_select at 0x7f0a38490f70>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:51.534101 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cf683a6b-08c6-4e68-8dcf-bda0937d2929 tempest-TestMinimumBasicScenario-1222037637 tempest-TestMinimumBasicScenario-1222037637-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1068774461" status: 202 len: 0 microversion: 2.1 time: 0.092659 May 24 10:07:51.540632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 447/882] 10.222.0.67 () {58 vars in 1272 bytes} [Mon May 24 10:07:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1068774461 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:07:53.585373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:53.586276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:53.599351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:53.600911 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:53.602804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:53.603892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:53.732543 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:07:54.215717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3f25924a-a3de-4b87-854e-61a18235aa6d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 204 len: 0 microversion: 2.20 time: 0.635807 May 24 10:07:54.217732 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 436/883] 10.222.0.67 () {60 vars in 1280 bytes} [Mon May 24 10:07:53 2021] DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:07:54.228614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:54.229812 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:54.242950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:54.243594 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:54.244458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:54.244916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:54.646495 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:54.665847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:54.672330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:54.672330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-30105698-3106-4221-83e0-6f4fb843552c tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.445692 May 24 10:07:54.672330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 448/884] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:54 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:55.700401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:55.701344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:55.710159 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:55.710742 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:55.711884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:55.712414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:56.186963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:56.207360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:56.210127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:56.212089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7afd92e2-b4cf-4aab-85a5-de2ba3df3187 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1724 microversion: 2.20 time: 0.516511 May 24 10:07:56.213441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 437/885] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:55 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1724 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:57.247373 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:57.249720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:57.266076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:57.267659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:57.269434 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:57.270452 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:57.606397 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:57.624407 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:57.626459 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:57.632181 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-679a4c5a-a4e8-4a47-b75f-873f5028b3eb tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1656 microversion: 2.20 time: 0.393462 May 24 10:07:57.644532 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 449/886] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:57 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1656 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:57.686524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-e824da3c-3d4c-4a9f-aa63-58ca2c64a2e5 req-1082b1e8-a46e-4235-8be3-ff11a1d1e1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a56d8-d836-470a-b693-994765367aec", "name": "network-vif-deleted", "tag": "00cb560b-b02f-42f4-9ee8-09089f5ae590"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:57.688349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:07:57.688349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:07:57.706753 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e824da3c-3d4c-4a9f-aa63-58ca2c64a2e5 req-1082b1e8-a46e-4235-8be3-ff11a1d1e1ea service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:57.707516 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e824da3c-3d4c-4a9f-aa63-58ca2c64a2e5 req-1082b1e8-a46e-4235-8be3-ff11a1d1e1ea service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:57.730534 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-e824da3c-3d4c-4a9f-aa63-58ca2c64a2e5 req-1082b1e8-a46e-4235-8be3-ff11a1d1e1ea service nova] Creating event network-vif-deleted:00cb560b-b02f-42f4-9ee8-09089f5ae590 for instance 812a56d8-d836-470a-b693-994765367aec on hv-cinder-79123 May 24 10:07:57.738861 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-e824da3c-3d4c-4a9f-aa63-58ca2c64a2e5 req-1082b1e8-a46e-4235-8be3-ff11a1d1e1ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056962 May 24 10:07:57.739664 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 438/887] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:07:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:07:58.650764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:58.651704 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:07:58.664557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:58.665409 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:58.666726 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:58.667953 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:58.850553 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:07:58.851018 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:07:58.851491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lazy-loading 'fault' on Instance uuid 812a56d8-d836-470a-b693-994765367aec {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:07:59.099604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:59.111697 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:59.114359 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee9a1c784bc4404782c67077a2cd8615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42fc1bb2ae6477fa7b7c9261f2d50bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:07:59.115874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6f3d8b57-93eb-4552-b977-05aff498e6b3 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 200 len: 1371 microversion: 2.20 time: 0.468986 May 24 10:07:59.117020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 450/888] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:07:58 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 1371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:08:00.145786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:00.147277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:00.163723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:00.164971 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:00.166586 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:00.168001 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:00.254203 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. May 24 10:08:00.254959 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:08:00.255839 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bd1a4252-c9bd-4183-9750-9554aa1d2d88 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 404 len: 111 microversion: 2.20 time: 0.120041 May 24 10:08:00.256734 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 439/889] 10.222.0.67 () {60 vars in 1277 bytes} [Mon May 24 10:08:00 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:08:00.266823 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9651c40d-aa70-4621-9f78-27e6e7a04a50 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '.version_select at 0x7f0a38490040>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:00.356201 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9651c40d-aa70-4621-9f78-27e6e7a04a50 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980096240" status: 204 len: 0 microversion: 2.20 time: 0.093907 May 24 10:08:00.356792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 451/890] 10.222.0.67 () {60 vars in 1259 bytes} [Mon May 24 10:08:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980096240 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 24 10:08:04.803697 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:04.804554 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:04.813961 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:04.814422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:04.815235 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:04.815698 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:04.886842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. May 24 10:08:04.886842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:08:04.886842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-16d0de46-0460-4e61-b212-a58157f6a3fe tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 404 len: 111 microversion: 2.1 time: 0.078741 May 24 10:08:04.886842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 440/891] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:08:04 2021] DELETE /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:08:04.895849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:04.896689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 812a56d8-d836-470a-b693-994765367aec] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:04.906729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:04.907423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:04.908336 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:04.908994 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:04.976885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. May 24 10:08:04.977531 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 812a56d8-d836-470a-b693-994765367aec could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:08:04.978381 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-590e3010-0499-4d4c-a9dd-4fe3375beb4d tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec" status: 404 len: 111 microversion: 2.1 time: 0.087329 May 24 10:08:04.979980 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 452/892] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:04 2021] GET /compute/v2.1/servers/812a56d8-d836-470a-b693-994765367aec => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:08:06.423234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:06.424725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:06.434668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:06.435371 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:06.436547 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:06.437346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:06.492622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. May 24 10:08:06.493267 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:08:06.494116 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1f9242a1-1259-4214-8b94-b3c15dd019aa tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 404 len: 111 microversion: 2.1 time: 0.076215 May 24 10:08:06.498581 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 441/893] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:08:06 2021] DELETE /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:08:06.504848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:06.504848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] [instance: 02d59782-db8b-4885-a4ec-a57499c07fe1] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:06.513429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:06.513965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:06.514851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:06.515371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:06.592077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] HTTP exception thrown: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. May 24 10:08:06.592460 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] Returning 404 to user: Instance 02d59782-db8b-4885-a4ec-a57499c07fe1 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:08:06.593547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-26c5f325-8837-44da-b5c3-39fa0239f9e1 tempest-AttachVolumeShelveTestJSON-1229989023 tempest-AttachVolumeShelveTestJSON-1229989023-project] 10.222.0.67 "GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1" status: 404 len: 111 microversion: 2.1 time: 0.093564 May 24 10:08:06.597840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 453/894] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:06 2021] GET /compute/v2.1/servers/02d59782-db8b-4885-a4ec-a57499c07fe1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:08:20.786566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1418208224", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:20.858407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] validate_networks() for [('52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:08:21.590834 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:08:21.591290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:08:21.592101 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:08:21.592517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:08:21.592931 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:08:21.602368 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:21.602905 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:21.603801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:21.604243 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:21.625168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:08:21.633797 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for user a5912dc5941e414ab392cb70961dadda and project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:08:21.647934 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:08:21.650740 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:08:21.842192 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-cf2978a0-14ec-4db1-9189-2cddc771e9ea tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221742 May 24 10:08:21.843333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 442/895] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:08:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:08:21.860940 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d548c48c-a397-47e6-a54b-e7704e8c56e9 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:21.862191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d548c48c-a397-47e6-a54b-e7704e8c56e9 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:21.967424 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d548c48c-a397-47e6-a54b-e7704e8c56e9 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:21.977737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d548c48c-a397-47e6-a54b-e7704e8c56e9 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1218 microversion: 2.1 time: 0.123852 May 24 10:08:21.978853 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 454/896] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:21 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:22.998884 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:22.999629 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:23.007984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:23.008508 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:23.009311 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:23.009752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:23.132081 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:23.141671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-43de428f-074b-457f-a454-b97c56bfe63c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1222 microversion: 2.1 time: 0.147402 May 24 10:08:23.142265 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 443/897] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:22 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:24.162735 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:24.164192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:24.179016 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:24.179761 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:24.180864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:24.181499 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:24.306238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:24.323112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-15a6e7bd-9ead-4750-b8d5-2ec5d187d16a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1270 microversion: 2.1 time: 0.167243 May 24 10:08:24.324405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 455/898] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:24 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:25.340737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:25.341492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:25.349407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:25.349868 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:25.350674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:25.351116 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:25.503247 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:25.512030 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c3f8295c-c1bb-4568-910b-0414eda43c01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1270 microversion: 2.1 time: 0.175145 May 24 10:08:25.512643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 444/899] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:25 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:26.531612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:26.532675 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:26.542487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:26.543134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:26.544167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:26.544664 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:26.670867 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:26.680356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-31bc9250-b431-4de3-87f3-6ebe5c2e8dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1270 microversion: 2.1 time: 0.154201 May 24 10:08:26.680994 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 456/900] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:26 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:27.699700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:27.700836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:27.710303 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:27.711097 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:27.712165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:27.712726 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:27.950029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:27.970083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1480c52f-5acb-4a02-ae63-847738aa9770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1276 microversion: 2.1 time: 0.264412 May 24 10:08:27.970083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 445/901] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:27 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:28.985677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:29.025218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:29.025218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:29.025218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:29.025218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:29.025874 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:29.424974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:29.443467 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f555d222-fc0c-4846-981d-ea243a2b179c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.462367 May 24 10:08:29.449829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 457/902] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:28 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:30.390935 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-fd70af56-9934-45f3-ad97-c6477ff97927 req-d5f2fe92-00a8-4d88-99ea-83b7b5d8eec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09bb9b57-7d05-4ff0-8c0e-5b7eac74665a", "tag": "3768267d-8ff1-4093-bb55-85e4456cd30d"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:30.395189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:08:30.395189 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:08:30.409769 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-fd70af56-9934-45f3-ad97-c6477ff97927 req-d5f2fe92-00a8-4d88-99ea-83b7b5d8eec3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:30.410333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-fd70af56-9934-45f3-ad97-c6477ff97927 req-d5f2fe92-00a8-4d88-99ea-83b7b5d8eec3 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:30.431111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-fd70af56-9934-45f3-ad97-c6477ff97927 req-d5f2fe92-00a8-4d88-99ea-83b7b5d8eec3 service nova] Creating event network-changed:3768267d-8ff1-4093-bb55-85e4456cd30d for instance 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a on hv-cinder-79123 May 24 10:08:30.436558 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-fd70af56-9934-45f3-ad97-c6477ff97927 req-d5f2fe92-00a8-4d88-99ea-83b7b5d8eec3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052406 May 24 10:08:30.437762 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 446/903] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:08:30.469019 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:30.469929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:30.483783 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:30.484748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:30.486103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:30.487304 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:30.823555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:30.840816 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a5f64d8a-f1c9-4928-95dd-a3ffb241efc1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.377188 May 24 10:08:30.849380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 458/904] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:30 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:31.866526 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:31.867362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:31.875946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:31.876471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:31.877283 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:31.877730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:32.185188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:32.194018 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-45336318-af2f-4b00-bb66-84423d7867eb tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.331803 May 24 10:08:32.194603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 447/905] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:31 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:33.211511 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.212111 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:33.219748 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:33.220211 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:33.221007 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:33.221475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:33.441180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:33.449928 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-1ce3ac36-f89e-48ea-95ec-1ddeba4beb58 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.242064 May 24 10:08:33.450516 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 459/906] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:33 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:34.467970 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:34.469263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:34.481377 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:34.482387 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:34.483824 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:34.484544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:34.736711 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:34.746379 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a2e273c3-6dc8-458a-b292-80b71c6fbfaa tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.283421 May 24 10:08:34.746965 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 448/907] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:34 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:08:35.768520 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:35.770139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:35.783035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:35.783680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:35.785037 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:35.785830 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:36.032918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:36.042907 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-76906197-ff91-4518-acba-eb667a066899 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.282727 May 24 10:08:36.043571 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 460/908] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:35 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:08:36.595105 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-ba4fc59f-e981-4f43-93ac-15f0457819a3 req-d452e8ea-77a3-46e3-974f-b70665ff8af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bb9b57-7d05-4ff0-8c0e-5b7eac74665a", "name": "network-vif-plugged", "status": "completed", "tag": "3768267d-8ff1-4093-bb55-85e4456cd30d"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:36.596762 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:08:36.596762 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:08:36.605675 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-ba4fc59f-e981-4f43-93ac-15f0457819a3 req-d452e8ea-77a3-46e3-974f-b70665ff8af1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:36.606127 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-ba4fc59f-e981-4f43-93ac-15f0457819a3 req-d452e8ea-77a3-46e3-974f-b70665ff8af1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:36.623964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-ba4fc59f-e981-4f43-93ac-15f0457819a3 req-d452e8ea-77a3-46e3-974f-b70665ff8af1 service nova] Creating event network-vif-plugged:3768267d-8ff1-4093-bb55-85e4456cd30d for instance 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a on hv-cinder-79123 May 24 10:08:36.631441 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-ba4fc59f-e981-4f43-93ac-15f0457819a3 req-d452e8ea-77a3-46e3-974f-b70665ff8af1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038492 May 24 10:08:36.632067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 449/909] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:08:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:08:37.062557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:37.064117 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:37.077550 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:37.078371 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:37.079845 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:37.080669 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:37.357229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:37.366190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b629c0c8-e216-4f4d-af69-7c896d90c15c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1318 microversion: 2.1 time: 0.309373 May 24 10:08:37.366775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 461/910] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:37 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:38.383502 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:38.384231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:38.392827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:38.393325 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:38.394143 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:38.394587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:38.680428 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:38.692393 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-32330545-f7cf-4ee3-9aae-6c957989886b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1508 microversion: 2.1 time: 0.313117 May 24 10:08:38.693455 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 450/911] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:38 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:40.756429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e09f92-70c5-4f1b-8cf7-ebe617267278"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:40.757474 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:40.765733 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:40.766197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:40.767009 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:40.767457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:41.912837 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b2f9d34d-9179-432b-b63e-16fd4ec59d74 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.159934 May 24 10:08:41.913958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 462/912] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:08:40 2021] POST /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a/os-volume_attachments => generated 194 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:08:53.272757 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-110884370", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:53.346643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] validate_networks() for [('52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:08:53.933600 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:08:53.934060 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:08:53.934561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:08:53.934979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:08:53.935403 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:08:53.944584 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:53.945041 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:53.945906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:53.946360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:53.966249 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:08:53.971003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for user a5912dc5941e414ab392cb70961dadda and project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:08:53.983568 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:08:53.986020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:08:54.145657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bc217a65-160c-41ac-abbf-44fc53c53db0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876445 May 24 10:08:54.147577 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 451/913] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:08:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:08:54.163445 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e5d4e2c9-e405-4eb7-a2c0-ae79ea4f6c68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:54.165100 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e5d4e2c9-e405-4eb7-a2c0-ae79ea4f6c68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:54.266796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e5d4e2c9-e405-4eb7-a2c0-ae79ea4f6c68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:54.276172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e5d4e2c9-e405-4eb7-a2c0-ae79ea4f6c68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1217 microversion: 2.1 time: 0.121580 May 24 10:08:54.277099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 463/914] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:54 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:55.302356 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:55.303011 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:55.311778 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:55.312236 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:55.313096 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:55.313547 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:55.472038 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:55.488626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1b3eecb3-348f-4de3-a178-ffa7f3f664bd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1221 microversion: 2.1 time: 0.189728 May 24 10:08:55.489760 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 452/915] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:55 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:08:56.511710 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:56.512871 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:56.525619 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:56.525995 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:56.526820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:56.527279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:56.659185 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:56.669622 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-027c5d53-593a-4ff7-961a-92fc5e328a88 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1269 microversion: 2.1 time: 0.164956 May 24 10:08:56.670237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 464/916] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:56 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:57.689753 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:57.690628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:57.698999 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:57.699457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:57.700276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:57.700717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:57.832346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:57.845397 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-47f49ace-3d02-44af-b36b-ef691ff96a31 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1275 microversion: 2.1 time: 0.159268 May 24 10:08:57.846270 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 453/917] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:57 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:58.882375 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:58.883570 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:08:58.899290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:58.900108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:58.902191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:58.902991 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:59.208265 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:08:59.220641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-dcf39f64-eefc-44af-8049-55d1e70bf1a0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.345255 May 24 10:08:59.221533 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 465/918] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:08:58 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:59.652868 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-b63fd001-e953-4f44-bfd0-57f6ccee6056 req-cac22b45-8c1a-4913-9a01-a04a5fffc76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39724a92-c826-4944-8a07-916d46da0e0d", "tag": "8868b74e-802d-457a-bde2-4bd4e630837c"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:08:59.659373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:08:59.659373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:08:59.665705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-b63fd001-e953-4f44-bfd0-57f6ccee6056 req-cac22b45-8c1a-4913-9a01-a04a5fffc76a service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:08:59.666407 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-b63fd001-e953-4f44-bfd0-57f6ccee6056 req-cac22b45-8c1a-4913-9a01-a04a5fffc76a service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:08:59.696988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-b63fd001-e953-4f44-bfd0-57f6ccee6056 req-cac22b45-8c1a-4913-9a01-a04a5fffc76a service nova] Creating event network-changed:8868b74e-802d-457a-bde2-4bd4e630837c for instance 39724a92-c826-4944-8a07-916d46da0e0d on hv-cinder-79123 May 24 10:08:59.705671 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-b63fd001-e953-4f44-bfd0-57f6ccee6056 req-cac22b45-8c1a-4913-9a01-a04a5fffc76a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056743 May 24 10:08:59.706344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 454/919] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:09:00.250387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:00.251263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:00.264498 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:00.265334 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:00.266787 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:00.267415 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:00.515480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:00.533457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8be8c8a8-7b8e-487b-872a-12b4c8163bc8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.290137 May 24 10:09:00.545784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 466/920] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:00 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:01.562307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:01.563039 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:01.571274 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:01.571788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:01.573310 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:01.573996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:01.912102 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:01.923176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f04dca1f-7976-4d0b-bef1-ead0e0d9a770 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.364983 May 24 10:09:01.923770 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 455/921] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:01 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:02.949159 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:02.949855 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:02.958333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:02.958792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:02.959603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:02.960250 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:03.261512 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:03.277956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-acca6216-bc61-47dc-98b0-0a30fc814482 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.333141 May 24 10:09:03.279262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 467/922] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:02 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:04.306391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:04.307062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:04.317912 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:04.318667 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:04.319707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:04.320355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:04.655697 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:04.665432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b7bca60c-e0ea-4713-8e82-7e12f7317f35 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.365381 May 24 10:09:04.666871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 456/923] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:04 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:04.828686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-6a66dbce-7b51-4b29-a18c-ffa69798eb2c req-7bf9564a-e77b-40bf-96b7-8c6139cd11b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39724a92-c826-4944-8a07-916d46da0e0d", "name": "network-vif-plugged", "status": "completed", "tag": "8868b74e-802d-457a-bde2-4bd4e630837c"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:04.831022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:04.831022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:09:04.841112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6a66dbce-7b51-4b29-a18c-ffa69798eb2c req-7bf9564a-e77b-40bf-96b7-8c6139cd11b9 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:04.841443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-6a66dbce-7b51-4b29-a18c-ffa69798eb2c req-7bf9564a-e77b-40bf-96b7-8c6139cd11b9 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:04.860173 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-6a66dbce-7b51-4b29-a18c-ffa69798eb2c req-7bf9564a-e77b-40bf-96b7-8c6139cd11b9 service nova] Creating event network-vif-plugged:8868b74e-802d-457a-bde2-4bd4e630837c for instance 39724a92-c826-4944-8a07-916d46da0e0d on hv-cinder-79123 May 24 10:09:04.866966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-6a66dbce-7b51-4b29-a18c-ffa69798eb2c req-7bf9564a-e77b-40bf-96b7-8c6139cd11b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043134 May 24 10:09:04.873290 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 468/924] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:09:05.686689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:05.688017 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:05.697316 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:05.697855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:05.698941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:05.699670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:05.996120 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:06.009118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6b23d7c8-dea9-4299-88c0-97d1a873cd76 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1317 microversion: 2.1 time: 0.326725 May 24 10:09:06.010817 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 457/925] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:05 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:07.036190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:07.036920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:07.045628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.046083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.046890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.047405 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.268153 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:07.278856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e0c47675-acc7-4bc0-b292-4d2166251d6f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1507 microversion: 2.1 time: 0.246744 May 24 10:09:07.279569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 469/926] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:07 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:07.311300 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e09f92-70c5-4f1b-8cf7-ebe617267278"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:07.312355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:07.320522 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.321193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.322067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.323139 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.508262 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Invalid volume: volume 12e09f92-70c5-4f1b-8cf7-ebe617267278 is already attached to instances: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a May 24 10:09:07.509372 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 400 to user: Invalid volume: volume 12e09f92-70c5-4f1b-8cf7-ebe617267278 is already attached to instances: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:09:07.511067 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-95cf058d-dfa6-4584-96af-30102e34ad01 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.204842 May 24 10:09:07.511666 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 458/927] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:09:07 2021] POST /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d/os-volume_attachments => generated 174 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:09:07.621281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:07.621794 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:07.629729 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.630181 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.630985 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:07.631437 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:07.837465 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lazy-loading 'services' on Instance uuid 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:09:08.125394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2ab19a64-2122-4c89-869a-2711595e0b0e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a/os-volume_attachments/12e09f92-70c5-4f1b-8cf7-ebe617267278" status: 202 len: 0 microversion: 2.1 time: 0.508347 May 24 10:09:08.126183 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 470/928] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:09:07 2021] DELETE /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a/os-volume_attachments/12e09f92-70c5-4f1b-8cf7-ebe617267278 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:09:11.632400 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 10:09:11.638221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-112603726", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:11.716990 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] validate_networks() for [('52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:09:12.432252 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:09:12.432825 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:09:12.433492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:09:12.433953 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:09:12.434432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:09:12.444457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:12.445003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:12.445932 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:12.446450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:12.467779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:09:12.472422 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for user a5912dc5941e414ab392cb70961dadda and project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:09:12.488153 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:09:12.492874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:09:12.653295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8e663f0b-8d44-4425-8bcc-22b1e094ff26 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023788 May 24 10:09:12.654281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 459/929] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:09:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:09:12.665480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a726c279-6dd5-4296-96a7-9bce3f594dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:12.666982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a726c279-6dd5-4296-96a7-9bce3f594dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:12.750963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a726c279-6dd5-4296-96a7-9bce3f594dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:12.764853 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a726c279-6dd5-4296-96a7-9bce3f594dbf tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1217 microversion: 2.1 time: 0.104069 May 24 10:09:12.765911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 471/930] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:12 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:13.793638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:13.795004 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:13.805602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:13.806118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:13.806981 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:13.807419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:13.808074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 36572. May 24 10:09:13.927565 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:13.942032 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-79f7ff26-e16a-437f-8616-e32c120ac221 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1221 microversion: 2.1 time: 0.152545 May 24 10:09:13.943052 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 460/931] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:13 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:14.961590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:14.962481 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:14.972689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:14.973448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:14.974651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:14.975259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:15.107062 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:15.124579 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-744474e9-c429-4dc7-8ced-c3504d7d3c59 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1269 microversion: 2.1 time: 0.168218 May 24 10:09:15.126282 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 472/932] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:14 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:16.160723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:16.162882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:16.178923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:16.179818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:16.181305 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:16.182080 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:16.401923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:16.426983 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c4ce595e-6e00-43bc-b713-b4db138400d0 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1275 microversion: 2.1 time: 0.276856 May 24 10:09:16.428064 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 461/933] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:16 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1275 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:17.453083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:17.455480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:17.470042 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:17.470910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:17.472387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:17.473230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:17.880764 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:17.895487 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cb1fa9f2-2f1a-4f72-91f1-c01c7144d624 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.449323 May 24 10:09:17.898162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 473/934] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:17 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:18.480114 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-7d05f146-89b6-4d29-b001-66d4ab7c545b req-52b749a1-f055-4728-ab16-de3ac509d056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2ef85f-1bb0-41c4-bfab-d49ac6f59185", "tag": "aeb4b23e-f182-4da2-a23f-751d3b29c315"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:18.481803 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:18.481803 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:09:18.490923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-7d05f146-89b6-4d29-b001-66d4ab7c545b req-52b749a1-f055-4728-ab16-de3ac509d056 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:18.491373 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-7d05f146-89b6-4d29-b001-66d4ab7c545b req-52b749a1-f055-4728-ab16-de3ac509d056 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:18.508785 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-7d05f146-89b6-4d29-b001-66d4ab7c545b req-52b749a1-f055-4728-ab16-de3ac509d056 service nova] Creating event network-changed:aeb4b23e-f182-4da2-a23f-751d3b29c315 for instance 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 on hv-cinder-79123 May 24 10:09:18.513991 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-7d05f146-89b6-4d29-b001-66d4ab7c545b req-52b749a1-f055-4728-ab16-de3ac509d056 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038207 May 24 10:09:18.514749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 462/935] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:09:18.916926 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:18.917833 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:18.926476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:18.926915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:18.928158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:18.928754 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:19.192414 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:19.202377 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4db96e10-6e42-4c2f-80c1-ad116bfe5ab5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.290022 May 24 10:09:19.203065 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 474/936] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:18 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:20.226360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:20.227083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:20.236141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:20.236601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:20.237435 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:20.237885 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:20.577917 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:20.594257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3d958cfc-be41-4f6c-aaeb-44f7f42f07a3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.372030 May 24 10:09:20.595318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 463/937] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:20 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:21.612260 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:21.612895 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:21.621429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:21.621890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:21.622698 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:21.623150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:21.858200 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:21.864059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bd6dd3ae-40bc-48bb-9b92-913cb65706fe tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.255492 May 24 10:09:21.864983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 475/938] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:21 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:22.883505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:22.884404 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:22.896099 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:22.897166 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:22.898832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:22.899813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:23.192662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:23.207135 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0ec580ef-c433-4038-9753-638d7d4ca52e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.327185 May 24 10:09:23.207135 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 464/939] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:22 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:24.225735 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:24.226375 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:24.235081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:24.235542 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:24.236349 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:24.236805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:24.454898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:24.464022 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-85eda884-c8d9-4e2d-ba11-4273c58a601d tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.242092 May 24 10:09:24.464615 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 476/940] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:24 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:24.964094 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-a492f040-b608-4f0a-8c81-09d370f34062 req-a85fc420-0967-45e6-ab37-ba286560a462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2ef85f-1bb0-41c4-bfab-d49ac6f59185", "name": "network-vif-plugged", "status": "completed", "tag": "aeb4b23e-f182-4da2-a23f-751d3b29c315"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:24.965881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:24.965881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:09:24.974829 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-a492f040-b608-4f0a-8c81-09d370f34062 req-a85fc420-0967-45e6-ab37-ba286560a462 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:24.975388 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-a492f040-b608-4f0a-8c81-09d370f34062 req-a85fc420-0967-45e6-ab37-ba286560a462 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:24.994821 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-a492f040-b608-4f0a-8c81-09d370f34062 req-a85fc420-0967-45e6-ab37-ba286560a462 service nova] Creating event network-vif-plugged:aeb4b23e-f182-4da2-a23f-751d3b29c315 for instance 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 on hv-cinder-79123 May 24 10:09:25.000670 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-a492f040-b608-4f0a-8c81-09d370f34062 req-a85fc420-0967-45e6-ab37-ba286560a462 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040379 May 24 10:09:25.001439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 465/941] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:09:25.481767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:25.482480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:25.490372 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:25.490835 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:25.491652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:25.492101 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:25.767643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:25.782384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-280d1b4a-aede-4374-9149-6061ca124c17 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1317 microversion: 2.1 time: 0.304472 May 24 10:09:25.783651 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 477/942] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:25 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:26.810077 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:26.810789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:26.822119 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:26.823147 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:26.823878 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:26.824514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:27.206636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:27.219045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ecf920f0-6db2-4ca5-812f-0033e021e286 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1507 microversion: 2.1 time: 0.412892 May 24 10:09:27.219892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 466/943] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:26 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:29.325870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f85ca7d2-7396-4691-8438-11d61191e79f"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:29.328096 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:29.342187 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:29.343048 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:29.344476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:29.345333 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:30.670524 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d02cf86c-9fb5-44be-8de6-f03e4a3b9ecd tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.352877 May 24 10:09:30.672083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 478/944] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:09:29 2021] POST /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments => generated 194 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:09:32.133662 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:32.134674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:32.151205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:32.154993 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:32.156605 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:32.157477 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:32.272421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lazy-loading 'flavor' on Instance uuid 0eb2af08-e089-403d-8235-25b4d4ab656d {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:09:32.904190 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e1e19eff-2321-4a16-858a-b884163879bc tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "POST /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d/action" status: 202 len: 0 microversion: 2.1 time: 0.776739 May 24 10:09:32.914661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 467/945] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:09:32 2021] POST /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:09:32.926863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:32.929932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:32.945565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:32.946681 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:32.948168 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:32.948890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:33.276052 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:33.283986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d040e6f0-36f1-488d-a6e9-a0f63af3e35b tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.361712 May 24 10:09:33.285035 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 479/946] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:32 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:34.361430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:34.362680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:34.375871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:34.376631 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:34.378284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:34.379291 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:34.706791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:34.716331 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-59004045-9a9e-47be-a6ac-2d84b175d86d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.362770 May 24 10:09:34.720844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 468/947] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:34 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:35.740796 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:35.742067 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:35.764171 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:35.765223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:35.766648 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:35.767449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:36.048433 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:36.058613 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-417b2e7d-3ab8-4c23-a119-81a41bb2ac87 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.324673 May 24 10:09:36.059214 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 480/948] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:35 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:37.084979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:37.085808 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:37.093841 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:37.094290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:37.095090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:37.095527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:37.372897 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:37.382449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-60be9b48-7426-48a5-bf5a-e7f0470fec45 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.302554 May 24 10:09:37.386414 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 469/949] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:37 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:38.402599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:38.403339 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:38.411342 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:38.411855 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:38.412712 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:38.413591 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:38.636177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:38.652911 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d49d2934-28b9-42db-bb50-5eb823fe93b5 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.254251 May 24 10:09:38.654014 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 481/950] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:38 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:38.940116 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f85ca7d2-7396-4691-8438-11d61191e79f"}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:38.941246 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:38.949900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:38.954984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:38.954984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:38.954984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:39.121610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Invalid volume: volume f85ca7d2-7396-4691-8438-11d61191e79f is already attached to instances: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 May 24 10:09:39.122418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 400 to user: Invalid volume: volume f85ca7d2-7396-4691-8438-11d61191e79f is already attached to instances: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:09:39.123858 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c73f150e-c97c-494c-a79d-5802212b5f6c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187681 May 24 10:09:39.124870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 470/951] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:09:38 2021] POST /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:09:39.264683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:39.265617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:39.281637 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:39.282355 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:39.283829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:39.284645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:39.485519 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lazy-loading 'services' on Instance uuid 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:09:39.673432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:39.674360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:39.684186 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:39.684804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:39.685925 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:39.686471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:39.847211 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-77e0c092-d8ad-40f6-84ed-9329cba3f888 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments/f85ca7d2-7396-4691-8438-11d61191e79f" status: 202 len: 0 microversion: 2.1 time: 0.583438 May 24 10:09:39.848735 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 482/952] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:09:39 2021] DELETE /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185/os-volume_attachments/f85ca7d2-7396-4691-8438-11d61191e79f => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:09:39.977747 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:39.998024 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-7a92c5ab-8548-4ed8-85ac-5391c5d66ab6 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.329709 May 24 10:09:40.001381 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 471/953] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:39 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:41.019458 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:41.020329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:41.031357 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:41.032172 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:41.033636 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:41.034470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:41.331942 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:41.342064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d16dac0a-2014-4b64-9571-dac6df65c188 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.326917 May 24 10:09:41.342820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 483/954] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:41 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:42.359528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:42.359528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:42.367391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:42.367844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:42.368686 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:42.369158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:42.395884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1687361152", "imageRef": "1e394696-5ece-44c2-8593-98802291881c", "flavorRef": "452", "networks": [{"uuid": "52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:42.495754 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] validate_networks() for [('52ca9fee-c69b-4d5c-b7bb-52812f9c5bbd', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:09:42.653643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:42.662942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d143948d-ae5c-4ac8-b45d-d82bd5579997 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.307621 May 24 10:09:42.663836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 472/955] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:42 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:43.287262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:09:43.287951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:09:43.288700 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:09:43.289202 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:09:43.289623 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:09:43.299464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:43.299910 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:43.300719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:43.301217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:43.328537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:09:43.336270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Getting quotas for user a5912dc5941e414ab392cb70961dadda and project 8e85a9260aad4c93aa21262f8764f011. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:09:43.356555 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:09:43.361136 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e394696-5ece-44c2-8593-98802291881c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:09:43.555354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ae7ecaf9-338f-4772-b9a0-1e2b1a3bc78f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163098 May 24 10:09:43.560180 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 484/956] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:09:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:09:43.567212 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-bb5956fb-5d1a-4216-a5ea-23a772078ba1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:43.567963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-bb5956fb-5d1a-4216-a5ea-23a772078ba1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:43.654053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-bb5956fb-5d1a-4216-a5ea-23a772078ba1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:43.662539 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-bb5956fb-5d1a-4216-a5ea-23a772078ba1 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1218 microversion: 2.1 time: 0.099088 May 24 10:09:43.663873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 473/957] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:43 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:43.690024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:43.691331 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:43.699332 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:43.699800 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:43.700615 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:43.701078 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:43.929121 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:43.939262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8f361ea8-fd54-401f-bcbd-dc5073684e33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.253211 May 24 10:09:43.940431 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 485/958] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:43 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:44.686009 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:44.686902 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:44.696924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:44.697566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:44.698504 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:44.699035 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:44.845346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:44.855289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-dd67f613-e2f8-4be1-9cd0-91183c84ed66 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1222 microversion: 2.1 time: 0.174591 May 24 10:09:44.855896 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 474/959] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:44 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:44.959303 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:44.959978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:44.968410 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:44.968870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:44.969810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:44.970262 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:45.193739 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:45.208295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ef5268ae-887b-41e9-996d-e0a0d066b551 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.252439 May 24 10:09:45.209230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 486/960] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:44 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:45.873914 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:45.874744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:45.883070 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:45.883657 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:45.885184 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:45.885737 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:46.016391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:46.025996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-06ff5f43-36ff-4f78-b94d-6c4e40ac74d8 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1270 microversion: 2.1 time: 0.156028 May 24 10:09:46.026595 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 475/961] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:45 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:46.228612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:46.230300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:46.240086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:46.243151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:46.243151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:46.243151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:46.671427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:46.680685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ff0d14ee-cab3-4426-b077-5c3438eb2dfd tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.457408 May 24 10:09:46.681493 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 487/962] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:46 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:47.044470 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:47.045616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:47.054123 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:47.055043 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:47.056017 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:47.056679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:47.341606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:47.350886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d6b04acf-ae98-4380-9479-84548d376f3b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1276 microversion: 2.1 time: 0.311077 May 24 10:09:47.351527 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 476/963] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:47 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:47.708614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:47.709689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:47.719689 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:47.721891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:47.721891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:47.722277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:48.053843 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:48.069464 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-82210cd4-2622-494f-9f57-4423c614ca97 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.364678 May 24 10:09:48.072445 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 488/964] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:47 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:48.374842 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:48.376042 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:48.390528 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:48.397921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:48.397921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:48.397921 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:49.058549 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:49.075216 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-65d0f513-bbe0-4206-9a21-fc0a15aa3fe4 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.707821 May 24 10:09:49.076622 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 477/965] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:48 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:49.095652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:49.097077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:49.112269 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:49.113231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:49.114838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:49.115865 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:49.280531 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-e5f443be-7e4f-44b8-90db-1ac14967423f req-761ffd16-133f-469d-9e35-44a2972d75a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8beb81-ad4f-4a82-be8e-55512f7ed570", "tag": "f24b7dd1-0def-4abf-89e7-2699ed5e0fe1"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:49.281450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:49.281450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:09:49.299073 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e5f443be-7e4f-44b8-90db-1ac14967423f req-761ffd16-133f-469d-9e35-44a2972d75a5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:49.299804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e5f443be-7e4f-44b8-90db-1ac14967423f req-761ffd16-133f-469d-9e35-44a2972d75a5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:49.332836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-e5f443be-7e4f-44b8-90db-1ac14967423f req-761ffd16-133f-469d-9e35-44a2972d75a5 service nova] Creating event network-changed:f24b7dd1-0def-4abf-89e7-2699ed5e0fe1 for instance 0e8beb81-ad4f-4a82-be8e-55512f7ed570 on hv-cinder-79123 May 24 10:09:49.341254 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-e5f443be-7e4f-44b8-90db-1ac14967423f req-761ffd16-133f-469d-9e35-44a2972d75a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073764 May 24 10:09:49.341873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 478/966] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:09:49.628425 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:49.640679 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-12f8842d-9d13-4480-ac93-1c01704e750f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.553523 May 24 10:09:49.641626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 489/967] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:49 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:50.098273 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:50.099712 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:50.108728 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:50.109280 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:50.110110 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:50.111399 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:50.441594 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:50.457830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0316f04c-9272-40d8-b831-e879df344fc5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.364114 May 24 10:09:50.458936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 479/968] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:50 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:50.660204 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:50.660858 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:50.669167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:50.669637 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:50.670461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:50.670916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:50.906330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:50.916317 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-814e4d38-af3d-47c5-aa8f-b72fdf59cbe9 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.259848 May 24 10:09:50.917229 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 490/969] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:50 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:51.485444 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:51.486303 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:51.495003 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:51.495471 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:51.496290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:51.496743 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:51.870452 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:51.887164 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ab1e347b-96e8-4da9-8abd-8ef5932b9b91 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.410695 May 24 10:09:51.888255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 480/970] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:51 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:51.943548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:51.943548 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:51.955041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:51.955881 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:51.957413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:51.958232 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:52.261508 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:52.271488 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8f110800-9a4d-4231-ad32-a7c4ceca5632 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.340121 May 24 10:09:52.272083 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 491/971] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:51 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:52.907679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:52.908939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:52.924684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:52.924684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:52.924684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:52.924684 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:53.142176 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:53.151892 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-998294e2-9a0a-497f-b09d-f4949ad07458 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.248354 May 24 10:09:53.152492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 481/972] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:52 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:53.289777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:53.290828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:53.299173 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:53.299621 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:53.300411 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:53.300846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:53.603420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:53.622774 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8af2050b-677f-4e83-a3be-213de19cf04f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1567 microversion: 2.1 time: 0.336599 May 24 10:09:53.623949 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 492/973] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:53 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:53.650146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:53.650745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:53.658592 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:53.659053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:53.659864 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:53.660309 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:53.995174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-93ca72b1-7fde-4bbb-b6ca-bd429d322645 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "POST /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d/action" status: 202 len: 0 microversion: 2.1 time: 0.348390 May 24 10:09:53.997104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 482/974] 10.222.0.67 () {60 vars in 1278 bytes} [Mon May 24 10:09:53 2021] POST /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:09:54.009951 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:54.011295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:54.025536 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:54.026351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:54.027814 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:54.028576 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:54.170663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:54.171721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:54.181795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:54.182437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:54.183489 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:54.184056 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:54.336138 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:54.348272 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7b469299-2e51-44ba-86a6-fd1082c200a8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1515 microversion: 2.1 time: 0.346251 May 24 10:09:54.348961 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 493/975] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:54 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:54.477833 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:54.494048 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-af348b7f-7176-480a-a996-8b30eb26c1c6 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.327471 May 24 10:09:54.495136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 483/976] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:54 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:55.076045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-648945a3-0399-424c-8f8c-500a790cb59b req-d6820ccf-d3ea-42cd-a259-f5dce5b57300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8beb81-ad4f-4a82-be8e-55512f7ed570", "name": "network-vif-plugged", "status": "completed", "tag": "f24b7dd1-0def-4abf-89e7-2699ed5e0fe1"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:55.079346 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:55.079346 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:09:55.095435 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-648945a3-0399-424c-8f8c-500a790cb59b req-d6820ccf-d3ea-42cd-a259-f5dce5b57300 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:55.096268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-648945a3-0399-424c-8f8c-500a790cb59b req-d6820ccf-d3ea-42cd-a259-f5dce5b57300 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:55.131015 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-648945a3-0399-424c-8f8c-500a790cb59b req-d6820ccf-d3ea-42cd-a259-f5dce5b57300 service nova] Creating event network-vif-plugged:f24b7dd1-0def-4abf-89e7-2699ed5e0fe1 for instance 0e8beb81-ad4f-4a82-be8e-55512f7ed570 on hv-cinder-79123 May 24 10:09:55.139145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-648945a3-0399-424c-8f8c-500a790cb59b req-d6820ccf-d3ea-42cd-a259-f5dce5b57300 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072272 May 24 10:09:55.139780 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 494/977] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:09:55.374599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:55.378210 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:55.391888 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:55.392294 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:55.393164 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:55.394123 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:55.520685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:55.521713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:55.530480 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:55.531419 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:55.537266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:55.538230 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:55.732517 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:55.750604 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-eea0c10d-cbe6-4e49-977c-53f2a0ea4ef0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1517 microversion: 2.1 time: 0.381701 May 24 10:09:55.751904 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 484/978] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:55 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1517 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:55.805158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:55.814491 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-64538c17-91f7-4d12-aad5-13a32c46bc0a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.298135 May 24 10:09:55.815081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 495/979] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:55 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:56.777318 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:56.778141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:56.786125 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:56.795624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:56.795624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:56.795624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:56.838199 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:56.839447 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:56.856270 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:56.857141 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:56.858775 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:56.859904 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:57.136323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:57.145852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6184ed3b-b972-40ab-81ba-c541fb098eac tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1318 microversion: 2.1 time: 0.315995 May 24 10:09:57.146455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 496/980] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:56 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:57.155327 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-ff5d2032-c822-429c-9d03-f8c43c1d0fb8 req-c88464e1-99c0-47a0-b91f-45bedc76f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "name": "network-vif-unplugged", "status": "completed", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:09:57.156984 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:09:57.156984 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:09:57.166932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ff5d2032-c822-429c-9d03-f8c43c1d0fb8 req-c88464e1-99c0-47a0-b91f-45bedc76f8b1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:57.167420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-ff5d2032-c822-429c-9d03-f8c43c1d0fb8 req-c88464e1-99c0-47a0-b91f-45bedc76f8b1 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:57.167566 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:57.177411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-78a7543b-1f67-4b89-a5d7-98e6e029fda8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.404037 May 24 10:09:57.178481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 485/981] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:56 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:57.185783 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-ff5d2032-c822-429c-9d03-f8c43c1d0fb8 req-c88464e1-99c0-47a0-b91f-45bedc76f8b1 service nova] Creating event network-vif-unplugged:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:09:57.190805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-ff5d2032-c822-429c-9d03-f8c43c1d0fb8 req-c88464e1-99c0-47a0-b91f-45bedc76f8b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039111 May 24 10:09:57.191702 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 497/982] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:09:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:09:58.168573 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:58.170779 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:58.180611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:58.182198 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:58.183234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:58.183781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:58.207699 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:58.209915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:58.228226 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:58.229232 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:58.231335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:58.232645 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:58.623781 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:58.634691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-da0d177d-c007-4ec8-a371-28393c4ca02a tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1509 microversion: 2.1 time: 0.473721 May 24 10:09:58.635668 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 486/983] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:58 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:09:58.689659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:58.699627 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-73b20086-9d30-4e17-acaa-634c5eda418f tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.501050 May 24 10:09:58.701306 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 498/984] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:58 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:09:59.717391 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:09:59.718230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:09:59.726247 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:59.726789 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:59.727960 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:09:59.728623 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:09:59.963515 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:09:59.973418 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-6171fd63-b556-4e10-bead-65943f6c00ff tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.259809 May 24 10:09:59.974053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 487/985] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:09:59 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:00.850231 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddbd5c18-5c3a-4091-8e5b-f12836b568f5"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:00.851298 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:00.859990 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:00.860530 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:00.863585 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:00.867492 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:00.996547 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:00.997232 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:01.005277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:01.005739 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:01.006596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:01.007049 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:01.287713 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:01.297752 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-53e1463e-5d2a-4ead-9a9c-eb96e03e1fef tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.305958 May 24 10:10:01.298337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 488/986] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:00 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:10:02.114446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-541309a5-9e94-4463-9c37-c8d18376456c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "POST /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.268198 May 24 10:10:02.115417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 499/987] 10.222.0.67 () {60 vars in 1323 bytes} [Mon May 24 10:10:00 2021] POST /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570/os-volume_attachments => generated 194 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:10:02.327115 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:02.328026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:02.336939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:02.337433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:02.338452 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:02.338663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:02.646977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:02.657163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e4decd05-d442-4ae0-b864-fbf008567d18 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.337235 May 24 10:10:02.657946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 489/988] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:02 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:03.676877 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:03.682568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:03.687583 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:03.688220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:03.689470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:03.690079 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:03.917542 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:03.928220 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c5d88956-0eca-409d-bdb1-f5c5eef28f4e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.255822 May 24 10:10:03.928894 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 500/989] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:03 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:04.945680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:04.947083 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:04.954802 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:04.955268 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:04.956044 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:04.956479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:05.214598 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:05.224413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-902ce27f-6068-4a71-a4e4-bfba0e8634a0 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.282459 May 24 10:10:05.225002 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 490/990] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:04 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:06.243080 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:06.244863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:06.254692 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:06.255153 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:06.255983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:06.256420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:06.482916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:06.494610 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cbf87f82-a8bf-49f2-b26b-8330506a7f46 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.254853 May 24 10:10:06.495390 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 501/991] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:06 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:07.098205 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-e53114b7-92f6-4242-921b-46556944ddf9 req-78b25a23-43d0-4460-91ef-1c1f285edc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "name": "network-vif-plugged", "status": "completed", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:07.100045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:07.100045 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:10:07.109946 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e53114b7-92f6-4242-921b-46556944ddf9 req-78b25a23-43d0-4460-91ef-1c1f285edc87 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:07.110389 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-e53114b7-92f6-4242-921b-46556944ddf9 req-78b25a23-43d0-4460-91ef-1c1f285edc87 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:07.131836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-e53114b7-92f6-4242-921b-46556944ddf9 req-78b25a23-43d0-4460-91ef-1c1f285edc87 service nova] Creating event network-vif-plugged:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:10:07.137939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-e53114b7-92f6-4242-921b-46556944ddf9 req-78b25a23-43d0-4460-91ef-1c1f285edc87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046100 May 24 10:10:07.138618 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 491/992] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:10:07.513975 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:07.515029 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:07.523773 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:07.524228 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:07.525162 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:07.525601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:07.786059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:07.795338 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-79146e92-8a86-400d-8843-e3de442b7b48 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1573 microversion: 2.1 time: 0.285913 May 24 10:10:07.796626 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 502/993] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:07 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1573 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:10:08.819432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:08.819432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:08.823776 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:08.824290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:08.825924 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:08.827145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:09.083579 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:09.103087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-57f32a80-1aa6-4518-89fc-f88a4ea9e815 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1560 microversion: 2.1 time: 0.293150 May 24 10:10:09.109237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 492/994] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:08 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1560 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:10.533721 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:10.534551 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:10.544595 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:10.545080 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:10.545915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:10.546447 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:10.768285 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lazy-loading 'services' on Instance uuid 0e8beb81-ad4f-4a82-be8e-55512f7ed570 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:10:11.220518 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8fdac0d2-c446-479a-883c-bb95a138f60f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570/os-volume_attachments/ddbd5c18-5c3a-4091-8e5b-f12836b568f5" status: 202 len: 0 microversion: 2.1 time: 0.690851 May 24 10:10:11.221676 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 503/995] 10.222.0.67 () {58 vars in 1416 bytes} [Mon May 24 10:10:10 2021] DELETE /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570/os-volume_attachments/ddbd5c18-5c3a-4091-8e5b-f12836b568f5 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:10:15.026949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:15.027606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:15.036256 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:15.037026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:15.038745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:15.039264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:15.114505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:10:15.495777 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a666f3b2-8783-49cd-bb35-052c4c6aca1e tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 204 len: 0 microversion: 2.1 time: 0.473280 May 24 10:10:15.496355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 493/996] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:10:15 2021] DELETE /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:10:15.511215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:15.513304 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:15.524047 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:15.525184 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:15.526006 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:15.526478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:15.755086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:15.764278 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a16733d3-91e4-4f0a-a944-60a7634af793 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1515 microversion: 2.1 time: 0.262446 May 24 10:10:15.772324 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 504/997] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:15 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:16.790889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:16.791536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:16.799409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:16.799866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:16.800717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:16.801208 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:17.028090 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:17.038098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a31db4f7-e388-4702-a4fb-0038edae6734 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1515 microversion: 2.1 time: 0.252040 May 24 10:10:17.039033 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 494/998] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:16 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:18.059929 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:18.061147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:18.077629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:18.078432 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:18.080528 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:18.081392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:18.418479 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:18.433470 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6e9fe623-4281-4545-9403-d874bdd66bc7 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1515 microversion: 2.1 time: 0.380558 May 24 10:10:18.435281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 505/999] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:18 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1515 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:18.608857 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-2e9533eb-204b-460c-8602-6cf72f306467 req-7090ad64-2b41-41f6-b2b7-5f513a567913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8beb81-ad4f-4a82-be8e-55512f7ed570", "name": "network-vif-deleted", "tag": "f24b7dd1-0def-4abf-89e7-2699ed5e0fe1"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:18.614010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:18.614010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:10:18.628438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2e9533eb-204b-460c-8602-6cf72f306467 req-7090ad64-2b41-41f6-b2b7-5f513a567913 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:18.629166 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2e9533eb-204b-460c-8602-6cf72f306467 req-7090ad64-2b41-41f6-b2b7-5f513a567913 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:18.650282 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-2e9533eb-204b-460c-8602-6cf72f306467 req-7090ad64-2b41-41f6-b2b7-5f513a567913 service nova] Creating event network-vif-deleted:f24b7dd1-0def-4abf-89e7-2699ed5e0fe1 for instance 0e8beb81-ad4f-4a82-be8e-55512f7ed570 on hv-cinder-79123 May 24 10:10:18.657202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-2e9533eb-204b-460c-8602-6cf72f306467 req-7090ad64-2b41-41f6-b2b7-5f513a567913 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058792 May 24 10:10:18.658174 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 495/1000] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:19.459318 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:19.460207 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:19.469688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:19.470147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:19.471117 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:19.471565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:19.566776 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:19.567378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:19.567852 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.objects.instance [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lazy-loading 'fault' on Instance uuid 0e8beb81-ad4f-4a82-be8e-55512f7ed570 {{(pid=123672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:10:19.658076 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:19.669044 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ba140273-8ec3-4148-8bfd-63b22dd7cc51 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 200 len: 1308 microversion: 2.1 time: 0.213847 May 24 10:10:19.669743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 506/1001] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:19 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:20.694766 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:20.695690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 0e8beb81-ad4f-4a82-be8e-55512f7ed570] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:20.704366 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:20.704826 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:20.705672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:20.706124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:20.759899 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Instance 0e8beb81-ad4f-4a82-be8e-55512f7ed570 could not be found. May 24 10:10:20.760510 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 404 to user: Instance 0e8beb81-ad4f-4a82-be8e-55512f7ed570 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:10:20.761405 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-93c64558-b074-4987-98ba-569a6c7a8941 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570" status: 404 len: 111 microversion: 2.1 time: 0.071132 May 24 10:10:20.761979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 496/1002] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:20 2021] GET /compute/v2.1/servers/0e8beb81-ad4f-4a82-be8e-55512f7ed570 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:10:22.222703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:22.223266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:22.231629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:22.232087 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:22.232887 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:22.233358 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:22.300243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:10:22.706314 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-5e7f10a5-4503-4a92-9f56-fe694e6c9259 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 204 len: 0 microversion: 2.1 time: 0.486955 May 24 10:10:22.707047 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 507/1003] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:10:22 2021] DELETE /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:10:22.715893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:22.716540 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:22.724899 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:22.725413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:22.726232 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:22.726676 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:23.078536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:23.091544 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9edbb05a-47d5-4d81-b87f-12fc2c584fb3 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1513 microversion: 2.1 time: 0.379574 May 24 10:10:23.092191 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 497/1004] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:22 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1513 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:24.111364 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:24.112139 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:24.122151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:24.122670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:24.123700 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:24.124243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:24.353701 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:24.364253 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-29719d31-00e6-41a5-96d2-957596e95db2 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1513 microversion: 2.1 time: 0.257580 May 24 10:10:24.365064 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 508/1005] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:24 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:25.345505 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-468fa594-c31c-49e2-8035-dce241fa7e25 req-50bef6bd-3f92-4317-a05b-430a5d634900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2ef85f-1bb0-41c4-bfab-d49ac6f59185", "name": "network-vif-deleted", "tag": "aeb4b23e-f182-4da2-a23f-751d3b29c315"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:25.348639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:25.348639 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:10:25.361559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-468fa594-c31c-49e2-8035-dce241fa7e25 req-50bef6bd-3f92-4317-a05b-430a5d634900 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:25.362057 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-468fa594-c31c-49e2-8035-dce241fa7e25 req-50bef6bd-3f92-4317-a05b-430a5d634900 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:25.383546 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:25.384655 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:25.394485 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:25.395738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:25.396258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-468fa594-c31c-49e2-8035-dce241fa7e25 req-50bef6bd-3f92-4317-a05b-430a5d634900 service nova] Creating event network-vif-deleted:aeb4b23e-f182-4da2-a23f-751d3b29c315 for instance 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 on hv-cinder-79123 May 24 10:10:25.396677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:25.397335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:25.406337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-468fa594-c31c-49e2-8035-dce241fa7e25 req-50bef6bd-3f92-4317-a05b-430a5d634900 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064618 May 24 10:10:25.407743 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 498/1006] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:10:25.572169 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:25.593008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4f35db40-deca-4bd7-a095-68ebb6c137d5 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 200 len: 1471 microversion: 2.1 time: 0.214117 May 24 10:10:25.602191 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 509/1007] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:25 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:10:26.616109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:26.616832 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:26.625714 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:26.626169 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:26.626974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:26.627433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:26.697626 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Instance 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 could not be found. May 24 10:10:26.698877 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 404 to user: Instance 5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:10:26.699988 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e137b973-fe08-4354-aa1b-4e1f8689a005 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185" status: 404 len: 111 microversion: 2.1 time: 0.089954 May 24 10:10:26.700563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 499/1008] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:26 2021] GET /compute/v2.1/servers/5d2ef85f-1bb0-41c4-bfab-d49ac6f59185 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:10:26.709616 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:26.710648 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:26.718580 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:26.720109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:26.720109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:26.720416 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:26.793966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:10:27.328950 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-47a9a790-794a-454f-8a0e-b708ecb5482b tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 204 len: 0 microversion: 2.1 time: 0.623178 May 24 10:10:27.329606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 510/1009] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:10:26 2021] DELETE /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:10:27.345442 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:27.346134 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:27.354545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:27.355007 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:27.355896 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:27.356345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:27.694692 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:27.704720 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-1f208158-3484-4c11-adac-4014caf43720 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1513 microversion: 2.1 time: 0.363212 May 24 10:10:27.705419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 500/1010] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:27 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:28.724032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:28.724837 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:28.734923 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:28.735705 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:28.737140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:28.738072 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:29.239150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:29.254578 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b6319986-c0c7-4849-99be-e0ec2fca4a68 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1513 microversion: 2.1 time: 0.535202 May 24 10:10:29.255328 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 511/1011] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:28 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1513 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:29.965029 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-d67315d2-c434-46b6-9924-b7fff28c3104 req-fa6e0858-a8f4-4f95-a4c6-47db8f681ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39724a92-c826-4944-8a07-916d46da0e0d", "name": "network-vif-deleted", "tag": "8868b74e-802d-457a-bde2-4bd4e630837c"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:29.968860 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:29.968860 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:10:29.985500 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-d67315d2-c434-46b6-9924-b7fff28c3104 req-fa6e0858-a8f4-4f95-a4c6-47db8f681ef4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:29.986336 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-d67315d2-c434-46b6-9924-b7fff28c3104 req-fa6e0858-a8f4-4f95-a4c6-47db8f681ef4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:30.021725 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-d67315d2-c434-46b6-9924-b7fff28c3104 req-fa6e0858-a8f4-4f95-a4c6-47db8f681ef4 service nova] Creating event network-vif-deleted:8868b74e-802d-457a-bde2-4bd4e630837c for instance 39724a92-c826-4944-8a07-916d46da0e0d on hv-cinder-79123 May 24 10:10:30.032312 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-d67315d2-c434-46b6-9924-b7fff28c3104 req-fa6e0858-a8f4-4f95-a4c6-47db8f681ef4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075094 May 24 10:10:30.033749 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 501/1012] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:10:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:30.284330 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:30.285109 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:30.294797 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:30.294797 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:30.295435 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:30.295885 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:30.428301 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:30.445733 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-34b1d768-eed5-4a6f-981f-2290197b4a87 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 200 len: 1302 microversion: 2.1 time: 0.165032 May 24 10:10:30.446808 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 512/1013] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:30 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 1302 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:31.474199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:31.475017 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 39724a92-c826-4944-8a07-916d46da0e0d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:31.484335 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:31.484801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:31.485663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:31.486110 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:31.541995 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Instance 39724a92-c826-4944-8a07-916d46da0e0d could not be found. May 24 10:10:31.542607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 404 to user: Instance 39724a92-c826-4944-8a07-916d46da0e0d could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:10:31.543458 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-424bf9d8-1c4f-44ec-8ba4-95a170ac3821 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d" status: 404 len: 111 microversion: 2.1 time: 0.073602 May 24 10:10:31.544026 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 502/1014] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:31 2021] GET /compute/v2.1/servers/39724a92-c826-4944-8a07-916d46da0e0d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:10:32.983811 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:32.984786 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:32.998575 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:32.999391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:33.000846 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:33.001672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:33.068573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:10:33.386600 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c6d0a734-d51d-43e3-b0f7-ce5717d99211 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "DELETE /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 204 len: 0 microversion: 2.1 time: 0.409150 May 24 10:10:33.387192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 513/1015] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:10:32 2021] DELETE /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:10:33.395288 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:33.396202 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:33.404682 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:33.405172 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:33.406000 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:33.406497 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:33.804523 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:33.814279 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b2ac2235-b36b-48d8-8d7e-f1fe80222569 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1514 microversion: 2.1 time: 0.422755 May 24 10:10:33.814879 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 503/1016] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:33 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:34.833632 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:34.834259 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:34.842849 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:34.843292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:34.844125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:34.844573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:35.080795 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:35.089652 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7da820e6-88c9-4e2a-9508-12eaa5cb0c0f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1514 microversion: 2.1 time: 0.260360 May 24 10:10:35.090134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 514/1017] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:34 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:36.106492 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:36.107359 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:36.115296 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:36.115755 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:36.116569 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:36.117010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:36.570590 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:36.587612 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e72e991d-a1e5-4d14-a8fd-7e733e0f776f tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1514 microversion: 2.1 time: 0.484760 May 24 10:10:36.588432 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 504/1018] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:36 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1514 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:10:36.590440 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-80893f4c-530e-4fa5-9ec9-4e0dddec8a9c req-091536f5-955a-41e5-8813-0ec80ee45356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bb9b57-7d05-4ff0-8c0e-5b7eac74665a", "name": "network-vif-deleted", "tag": "3768267d-8ff1-4093-bb55-85e4456cd30d"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:36.595130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:36.595130 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:10:36.605542 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-80893f4c-530e-4fa5-9ec9-4e0dddec8a9c req-091536f5-955a-41e5-8813-0ec80ee45356 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:36.605995 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-80893f4c-530e-4fa5-9ec9-4e0dddec8a9c req-091536f5-955a-41e5-8813-0ec80ee45356 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:36.626248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-80893f4c-530e-4fa5-9ec9-4e0dddec8a9c req-091536f5-955a-41e5-8813-0ec80ee45356 service nova] Creating event network-vif-deleted:3768267d-8ff1-4093-bb55-85e4456cd30d for instance 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a on hv-cinder-79123 May 24 10:10:36.631756 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-80893f4c-530e-4fa5-9ec9-4e0dddec8a9c req-091536f5-955a-41e5-8813-0ec80ee45356 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048639 May 24 10:10:36.632569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 515/1019] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:10:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:37.608433 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:37.609360 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:37.618297 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:37.618856 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:37.619731 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:37.620230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:37.707836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:37.708355 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:37.708846 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lazy-loading 'fault' on Instance uuid 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:10:37.877647 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5912dc5941e414ab392cb70961dadda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e85a9260aad4c93aa21262f8764f011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:10:37.891674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d667e88c-f38f-4fea-97f3-6dd65dc67662 tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 200 len: 1308 microversion: 2.1 time: 0.287708 May 24 10:10:37.892700 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 505/1020] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:37 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:10:38.918659 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:38.919647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] [instance: 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:10:38.927569 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:38.928024 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:38.928832 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:10:38.929320 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:10:38.981831 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] HTTP exception thrown: Instance 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a could not be found. May 24 10:10:38.982455 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] Returning 404 to user: Instance 09bb9b57-7d05-4ff0-8c0e-5b7eac74665a could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:10:38.983427 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-91d30fe1-7174-434a-b178-3c9f94051e1c tempest-AttachVolumeNegativeTest-100008858 tempest-AttachVolumeNegativeTest-100008858-project] 10.222.0.67 "GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a" status: 404 len: 111 microversion: 2.1 time: 0.069676 May 24 10:10:38.984280 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 516/1021] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:10:38 2021] GET /compute/v2.1/servers/09bb9b57-7d05-4ff0-8c0e-5b7eac74665a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:10:40.718524 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:10:40.719195 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:10:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:10:42.816387 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8b13c697-1d3e-472e-af6f-508af917e8c1 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Action: 'create', calling method: .version_select at 0x7f0a38f32dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1470283540", "metadata": {"Type": "work"}}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:10:43.869349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8b13c697-1d3e-472e-af6f-508af917e8c1 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.162346 May 24 10:10:43.869349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 506/1022] 10.222.0.67 () {60 vars in 1156 bytes} [Mon May 24 10:10:42 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1165 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 10:10:43.870683 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-505116f9-27c7-4fe1-8dd5-9e11da362767 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a383a91f0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:44.003573 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-505116f9-27c7-4fe1-8dd5-9e11da362767 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 200 len: 353 microversion: 2.1 time: 0.143278 May 24 10:10:44.004296 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 517/1023] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:10:43 2021] GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:45.017421 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4817814f-2049-4b2c-8444-2246621d614e tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a385ed4c0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:45.248780 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4817814f-2049-4b2c-8444-2246621d614e tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 200 len: 354 microversion: 2.1 time: 0.234631 May 24 10:10:45.250046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 507/1024] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:10:45 2021] GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 354 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:10:45.265851 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-590f9cbf-4566-4801-9ae4-c856f5c37a2a tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a383a9040>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:45.371094 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-590f9cbf-4566-4801-9ae4-c856f5c37a2a tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 200 len: 354 microversion: 2.1 time: 0.112460 May 24 10:10:45.371784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 518/1025] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:10:45 2021] GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:45.389479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b0f9743d-6927-4a73-8b0f-374dc13a6a29 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a385ed310>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:45.672408 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b0f9743d-6927-4a73-8b0f-374dc13a6a29 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 202 len: 0 microversion: 2.1 time: 0.286740 May 24 10:10:45.673346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 508/1026] 10.222.0.67 () {58 vars in 1248 bytes} [Mon May 24 10:10:45 2021] DELETE /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:10:45.682860 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-de4b5a55-9ff1-4d78-93a6-14812af6bedf tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a38490ca0>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:45.868063 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-de4b5a55-9ff1-4d78-93a6-14812af6bedf tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 200 len: 353 microversion: 2.1 time: 0.189577 May 24 10:10:45.868661 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 519/1027] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:10:45 2021] GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 353 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:10:46.880994 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b95a96dd-52b3-43d0-85ee-2d3d65149aa7 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Calling method '.version_select at 0x7f0a385edee0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:10:46.948690 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-b95a96dd-52b3-43d0-85ee-2d3d65149aa7 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] HTTP exception thrown: Volume 5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 could not be found. May 24 10:10:46.949574 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b95a96dd-52b3-43d0-85ee-2d3d65149aa7 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] Returning 404 to user: Volume 5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:10:46.950599 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b95a96dd-52b3-43d0-85ee-2d3d65149aa7 tempest-VolumesGetTestJSON-1067117742 tempest-VolumesGetTestJSON-1067117742-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9" status: 404 len: 109 microversion: 2.1 time: 0.073488 May 24 10:10:46.951255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 509/1028] 10.222.0.67 () {58 vars in 1245 bytes} [Mon May 24 10:10:46 2021] GET /compute/v2.1/os-volumes/5a6bf09a-524b-45f9-afbd-bec15fd6b9f9 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:11:32.164677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:32.172566 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:32.188482 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:32.189192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:32.190565 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:32.191400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:32.288074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:11:32.465089 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-2ae83048-fde9-4f82-8b99-7a2f19911743 req-fc489f40-7422-4eff-a5e4-4f996baa07cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:11:32.467919 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:11:32.467919 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:11:32.479830 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2ae83048-fde9-4f82-8b99-7a2f19911743 req-fc489f40-7422-4eff-a5e4-4f996baa07cf service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:32.480311 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2ae83048-fde9-4f82-8b99-7a2f19911743 req-fc489f40-7422-4eff-a5e4-4f996baa07cf service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:32.498819 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-2ae83048-fde9-4f82-8b99-7a2f19911743 req-fc489f40-7422-4eff-a5e4-4f996baa07cf service nova] Creating event network-changed:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:11:32.504345 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-2ae83048-fde9-4f82-8b99-7a2f19911743 req-fc489f40-7422-4eff-a5e4-4f996baa07cf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.332692 May 24 10:11:32.505074 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 510/1029] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:11:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:11:32.740391 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0be8abbb-a359-4570-8b40-d651020aac95 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 204 len: 0 microversion: 2.1 time: 0.583086 May 24 10:11:32.742382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 520/1030] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:11:32 2021] DELETE /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:11:32.758828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:32.760784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:32.787108 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:32.788956 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:32.790989 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:32.792234 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:33.383148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:33.400784 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-8fcade31-5aa0-4a1a-b05c-3d5193cb4834 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.650446 May 24 10:11:33.401874 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 511/1031] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:32 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:11:34.425908 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:34.426408 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:34.434785 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:34.435243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:34.436045 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:34.436486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:34.799066 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:34.810001 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-17b60890-64ab-4ab1-aaba-166713ad9a33 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.389163 May 24 10:11:34.810590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 521/1032] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:34 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:11:35.828750 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:35.829625 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:35.837632 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:35.838146 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:35.838967 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:35.839411 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:36.072053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:36.088255 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ba1d4b19-5b2e-47de-8cb7-791e63e7823e tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1566 microversion: 2.1 time: 0.263644 May 24 10:11:36.089287 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 512/1033] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:35 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:11:37.110915 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:37.112134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:37.127286 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:37.128120 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:37.129966 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:37.131068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:37.513295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:37.527840 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f39ed61e-3850-416f-bd78-fc77a87b35c8 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1448 microversion: 2.1 time: 0.423162 May 24 10:11:37.529413 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 522/1034] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:37 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1448 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:11:38.350862 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-5aedbab2-9067-415d-aa7a-97c0942f20ea req-237f37d6-bfad-4269-86d5-ae041c150c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb2af08-e089-403d-8235-25b4d4ab656d", "name": "network-vif-deleted", "tag": "b5308ea7-0517-43e4-830b-7fd131b3a9c7"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:11:38.354340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:11:38.354340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:11:38.364233 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-5aedbab2-9067-415d-aa7a-97c0942f20ea req-237f37d6-bfad-4269-86d5-ae041c150c81 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:38.365129 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-5aedbab2-9067-415d-aa7a-97c0942f20ea req-237f37d6-bfad-4269-86d5-ae041c150c81 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:38.384452 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-5aedbab2-9067-415d-aa7a-97c0942f20ea req-237f37d6-bfad-4269-86d5-ae041c150c81 service nova] Creating event network-vif-deleted:b5308ea7-0517-43e4-830b-7fd131b3a9c7 for instance 0eb2af08-e089-403d-8235-25b4d4ab656d on hv-cinder-79123 May 24 10:11:38.389894 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-5aedbab2-9067-415d-aa7a-97c0942f20ea req-237f37d6-bfad-4269-86d5-ae041c150c81 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135627 May 24 10:11:38.390794 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 513/1035] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:11:38.559069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:38.560475 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:38.585863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:38.585863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:38.585863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:38.585863 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:38.743412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:38.752886 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-aceb4d7b-7e26-4c51-92c4-4aee2197d21d tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1381 microversion: 2.1 time: 0.201712 May 24 10:11:38.753557 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 523/1036] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:38 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1381 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:11:39.775459 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:39.776922 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:39.790200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:39.791463 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:39.792840 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:39.793341 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:40.044882 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d89f739ff940bc835dbe914ebc7043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96e2adbf10489aae7640c84f398b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:11:40.055796 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-faa43e46-ad2c-4635-aff7-7f9bea0f4b19 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 200 len: 1218 microversion: 2.1 time: 0.287401 May 24 10:11:40.056822 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 514/1037] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:39 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:11:41.082357 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:41.082952 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] [instance: 0eb2af08-e089-403d-8235-25b4d4ab656d] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:11:41.091956 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:41.092420 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:41.093384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:11:41.093870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:11:41.152181 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] HTTP exception thrown: Instance 0eb2af08-e089-403d-8235-25b4d4ab656d could not be found. May 24 10:11:41.152779 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Returning 404 to user: Instance 0eb2af08-e089-403d-8235-25b4d4ab656d could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:11:41.153650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-173373d9-d158-48c0-9354-eed38daad350 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d" status: 404 len: 111 microversion: 2.1 time: 0.075733 May 24 10:11:41.154243 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 524/1038] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:11:41 2021] GET /compute/v2.1/servers/0eb2af08-e089-403d-8235-25b4d4ab656d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:11:41.655721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a8ec24e6-12e4-455c-8479-8e7b29e4c698 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] Calling method '.version_select at 0x7f0a384b79d0>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:11:41.745288 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a8ec24e6-12e4-455c-8479-8e7b29e4c698 tempest-TestShelveInstance-1132599467 tempest-TestShelveInstance-1132599467-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-899814628" status: 202 len: 0 microversion: 2.1 time: 0.093321 May 24 10:11:41.745880 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 515/1039] 10.222.0.67 () {58 vars in 1251 bytes} [Mon May 24 10:11:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-899814628 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:12:29.510821 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Action: 'create', calling method: .version_select at 0x7f0a38379790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1733835921"}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:12:29.550343 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:12:29.555968 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for user c4dbf97d94554a0c826ff1b17db17474 and project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:12:30.036603 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:12:30.043854 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for user c4dbf97d94554a0c826ff1b17db17474 and project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'key_pairs'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:12:30.068958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-aa03ddce-5e6b-4f2c-aee0-f7c0f4b442ee tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.826971 May 24 10:12:30.070134 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 525/1040] 10.222.0.67 () {60 vars in 1158 bytes} [Mon May 24 10:12:29 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:12:34.267503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:12:34.268111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:12:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:12:51.616844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 10:12:51.620369 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1208025065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1733835921", "security_groups": [{"name": "tempest-secgroup-smoke-525824861"}], "block_device_mapping_v2": [{"uuid": "18285a16-d01b-488b-b5e4-8ac528cd13c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3670d884-4bc4-4d4e-8dbb-1165ed224ea7"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:12:51.791679 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] validate_networks() for [('3670d884-4bc4-4d4e-8dbb-1165ed224ea7', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:12:52.401193 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:12:52.401713 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:12:52.402260 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:12:52.402723 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:12:52.403210 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:12:52.414559 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:52.415015 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:52.415844 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:52.416287 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:52.436451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:12:52.441263 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for user c4dbf97d94554a0c826ff1b17db17474 and project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:12:52.554168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:12:52.556385 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18285a16-d01b-488b-b5e4-8ac528cd13c1',volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:12:52.637367 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38250. May 24 10:12:53.283158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9aaea6fb-7d52-43a4-8d19-9cb835ebddda tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.667385 May 24 10:12:53.284300 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 516/1041] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:12:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:12:53.296982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4618dd19-add8-44d1-87ea-ce9184cdeb06 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:53.296982 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4618dd19-add8-44d1-87ea-ce9184cdeb06 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:53.495750 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-4618dd19-add8-44d1-87ea-ce9184cdeb06 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:12:53.510212 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4618dd19-add8-44d1-87ea-ce9184cdeb06 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1095 microversion: 2.1 time: 0.218142 May 24 10:12:53.511380 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 526/1042] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:53 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1095 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:12:54.538495 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c890b570-34c6-4e9c-841f-de08afa08db9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:54.539866 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c890b570-34c6-4e9c-841f-de08afa08db9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:54.630323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c890b570-34c6-4e9c-841f-de08afa08db9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:12:54.638463 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c890b570-34c6-4e9c-841f-de08afa08db9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1095 microversion: 2.1 time: 0.105734 May 24 10:12:54.639079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 517/1043] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:54 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:12:55.656387 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:55.657500 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:55.669190 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:55.673642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:55.673642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:55.673642 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:55.849752 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:12:55.858341 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-56052edf-e0a7-4a53-8c21-90dafa2ef749 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1137 microversion: 2.1 time: 0.206166 May 24 10:12:55.858932 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 527/1044] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:55 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1137 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:12:56.879289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:56.879979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:56.887967 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:56.888424 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:56.889450 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:56.889901 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:57.064638 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:12:57.074786 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-71159f92-5485-4789-82e9-a60b172c9b92 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1201 microversion: 2.1 time: 0.199570 May 24 10:12:57.075368 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 518/1045] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:56 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1201 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:12:58.101244 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:58.102418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:58.116654 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:58.125329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:58.126263 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:58.126819 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:58.541365 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:12:58.552465 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7c1147fe-baf1-4edd-ad4a-4cddf9622e30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1278 microversion: 2.1 time: 0.458214 May 24 10:12:58.553412 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 528/1046] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:58 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1278 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:12:59.580883 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:59.582582 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:12:59.591337 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:59.591801 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:59.592652 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:59.593158 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:59.803449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-b4d90c76-5263-498c-8ea1-8c6bfc5f7cda req-2dcee980-1b46-46cc-af20-3597d1a063d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add96aba-6f75-4d91-b87a-8fe1918c02ab", "tag": "deb1beef-4279-4eb7-8f77-beec25a50790"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:12:59.805132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:12:59.805132 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:12:59.814321 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-b4d90c76-5263-498c-8ea1-8c6bfc5f7cda req-2dcee980-1b46-46cc-af20-3597d1a063d5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:12:59.815224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-b4d90c76-5263-498c-8ea1-8c6bfc5f7cda req-2dcee980-1b46-46cc-af20-3597d1a063d5 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:12:59.832556 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-b4d90c76-5263-498c-8ea1-8c6bfc5f7cda req-2dcee980-1b46-46cc-af20-3597d1a063d5 service nova] Creating event network-changed:deb1beef-4279-4eb7-8f77-beec25a50790 for instance add96aba-6f75-4d91-b87a-8fe1918c02ab on hv-cinder-79123 May 24 10:12:59.841385 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-b4d90c76-5263-498c-8ea1-8c6bfc5f7cda req-2dcee980-1b46-46cc-af20-3597d1a063d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042048 May 24 10:12:59.842322 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 529/1047] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:13:00.148465 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:00.159346 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-3f7e5b1a-c023-4451-9bcf-72276b82896a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.584932 May 24 10:13:00.159937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 519/1048] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:12:59 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:01.181104 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:01.181848 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:01.191223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:01.191719 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:01.192517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:01.192958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:01.414133 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:01.422870 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a84f66be-5403-4b6c-a16c-c05d28b07e4b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.246006 May 24 10:13:01.423446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 530/1049] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:01 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:02.440141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:02.441419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:02.449913 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:02.450423 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:02.451258 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:02.451704 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:02.661611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:02.670704 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4e3f87d1-70aa-4af1-b331-6393527c2492 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.234531 May 24 10:13:02.671293 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 520/1050] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:02 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:03.688562 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:03.689361 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:03.698275 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:03.712804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:03.712804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:03.712804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:03.919457 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:03.930543 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a3da82c1-9671-4925-8475-0d7dcf6bdf5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.245875 May 24 10:13:03.931177 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 531/1051] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:03 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:04.948479 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:04.949040 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:04.957636 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:04.958104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:04.958936 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:04.959388 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:05.201881 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:05.217591 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-349d9bdc-62cf-4ba8-bc4e-d87aa7afa636 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.272574 May 24 10:13:05.218649 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 521/1052] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:04 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:06.236268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:06.237532 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:06.245670 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:06.246125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:06.246937 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:06.247378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:06.566215 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:06.576360 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-8b70fd4c-44e5-459a-ae1f-2ee1f975d2e1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.344252 May 24 10:13:06.576958 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 532/1053] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:06 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:07.602237 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:07.603261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:07.612170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:07.613376 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:07.614349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:07.614996 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:07.836478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:07.845066 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9a597da2-fedd-4296-8a2d-9e02458e44e8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.246763 May 24 10:13:07.845713 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 522/1054] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:07 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:13:08.863084 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:08.863891 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:08.873817 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:08.874400 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:08.878963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:08.878963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:09.098743 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:09.108004 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-32b2b8e4-f3a1-4bc3-a4c9-24184df163c8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.249051 May 24 10:13:09.108671 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 533/1055] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:08 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:10.126870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:10.128501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:10.137141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:10.137674 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:10.138597 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:10.139257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:10.396132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:10.406457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d45b58b7-ab53-4179-99b9-d19d4717a4fe tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.283387 May 24 10:13:10.407370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 523/1056] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:10 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:13:11.427459 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:11.430471 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:11.436108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:11.436517 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:11.437406 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:11.437857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:11.679017 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:11.696196 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-cbcd1444-2ee3-42d5-aeb5-5dd30742ab07 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.272719 May 24 10:13:11.697366 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 534/1057] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:11 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:12.025979 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-3798e879-0f21-4722-a107-a2ac254d9bfd req-6aa16683-6168-47b1-baad-04930427801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add96aba-6f75-4d91-b87a-8fe1918c02ab", "name": "network-vif-plugged", "status": "completed", "tag": "deb1beef-4279-4eb7-8f77-beec25a50790"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:13:12.028035 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:13:12.028035 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:13:12.037141 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3798e879-0f21-4722-a107-a2ac254d9bfd req-6aa16683-6168-47b1-baad-04930427801d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:12.037601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3798e879-0f21-4722-a107-a2ac254d9bfd req-6aa16683-6168-47b1-baad-04930427801d service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:12.055841 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-3798e879-0f21-4722-a107-a2ac254d9bfd req-6aa16683-6168-47b1-baad-04930427801d service nova] Creating event network-vif-plugged:deb1beef-4279-4eb7-8f77-beec25a50790 for instance add96aba-6f75-4d91-b87a-8fe1918c02ab on hv-cinder-79123 May 24 10:13:12.061587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-3798e879-0f21-4722-a107-a2ac254d9bfd req-6aa16683-6168-47b1-baad-04930427801d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126652 May 24 10:13:12.062514 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 524/1058] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:13:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:13:12.715630 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:12.716354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:12.724650 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:12.725145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:12.725965 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:12.726602 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:12.951378 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:12.960462 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3d9f1b90-90a5-457a-a950-524e9c26330c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1266 microversion: 2.1 time: 0.248914 May 24 10:13:12.961086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 535/1059] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:12 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:13:13.979374 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:13.980062 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:13.988135 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:13.988685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:13.989587 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:13.990052 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:14.223198 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:14.232669 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-b2a6f263-4440-4805-966c-1aa3f46849b5 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1453 microversion: 2.1 time: 0.257620 May 24 10:13:14.233231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 525/1060] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:13 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1453 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:13:14.250223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:13:14.250898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:13:14.260736 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:14.261251 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:14.262100 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:14.262582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:14.487777 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:13:14.498059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-bc8b88f1-d846-40a8-b951-3b514ee8c6c0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1453 microversion: 2.1 time: 0.251592 May 24 10:13:14.498792 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 536/1061] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:13:14 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:13:18.312961 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-22091b59-2cda-4058-a7dd-c251250399fa req-18c9d9e2-6952-49c4-ae78-9edab2607dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add96aba-6f75-4d91-b87a-8fe1918c02ab", "tag": "deb1beef-4279-4eb7-8f77-beec25a50790"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:13:18.314613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:13:18.314613 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:13:18.323583 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-22091b59-2cda-4058-a7dd-c251250399fa req-18c9d9e2-6952-49c4-ae78-9edab2607dc4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:13:18.324046 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-22091b59-2cda-4058-a7dd-c251250399fa req-18c9d9e2-6952-49c4-ae78-9edab2607dc4 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:13:18.345268 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-22091b59-2cda-4058-a7dd-c251250399fa req-18c9d9e2-6952-49c4-ae78-9edab2607dc4 service nova] Creating event network-changed:deb1beef-4279-4eb7-8f77-beec25a50790 for instance add96aba-6f75-4d91-b87a-8fe1918c02ab on hv-cinder-79123 May 24 10:13:18.353124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-22091b59-2cda-4058-a7dd-c251250399fa req-18c9d9e2-6952-49c4-ae78-9edab2607dc4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043740 May 24 10:13:18.354036 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 526/1062] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:13:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:14:53.182996 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:14:53.183739 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:14:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:15:13.353720 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:13.354504 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:13.357842 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2026cb6-a8a3-46b7-8221-bfe52c9a18e3] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 10:15:13.364054 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:13.364513 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:13.365354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:13.365805 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:13.442606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:15:13.902828 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e51eeca4-5c35-4ed9-8b66-86fb1a2258c6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "DELETE /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 204 len: 0 microversion: 2.1 time: 0.553838 May 24 10:15:13.903483 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 537/1063] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:15:13 2021] DELETE /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:15:13.911226 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 24 10:15:13.916261 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:13.917200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:13.930394 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:13.931165 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:13.932085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:13.932653 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:14.166721 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:14.184109 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-349a7f8b-1e6f-4aa3-9cb3-7c4f28a5735d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1578 microversion: 2.1 time: 0.274494 May 24 10:15:14.185206 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 527/1064] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:13 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1578 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:15.211773 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:15.212568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:15.232853 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:15.233877 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:15.234703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:15.235147 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:15.272606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2026cb6-a8a3-46b7-8221-bfe52c9a18e3] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38354. May 24 10:15:15.466281 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:15.476722 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-0690d35e-d7ee-4208-80f5-55201acdd571 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1578 microversion: 2.1 time: 0.269252 May 24 10:15:15.477368 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 538/1065] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:15 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:16.495429 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:16.496362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:16.516349 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:16.516818 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:16.517744 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:16.518221 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:16.554610 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38358. May 24 10:15:16.704813 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:16.751451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e713c97d-fbe0-4e9c-a37e-e969e63bcdf4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1511 microversion: 2.1 time: 0.231465 May 24 10:15:16.751451 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 528/1066] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:16 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:17.290499 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-a01f507d-ad79-4dbf-877b-5b807c742c26 req-c4e2bc2f-7d0f-400a-81c9-9a6c9238b9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add96aba-6f75-4d91-b87a-8fe1918c02ab", "name": "network-vif-deleted", "tag": "deb1beef-4279-4eb7-8f77-beec25a50790"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:17.294150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:15:17.294150 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:15:17.310925 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a01f507d-ad79-4dbf-877b-5b807c742c26 req-c4e2bc2f-7d0f-400a-81c9-9a6c9238b9bd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:17.312394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-a01f507d-ad79-4dbf-877b-5b807c742c26 req-c4e2bc2f-7d0f-400a-81c9-9a6c9238b9bd service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:17.348494 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-a01f507d-ad79-4dbf-877b-5b807c742c26 req-c4e2bc2f-7d0f-400a-81c9-9a6c9238b9bd service nova] Creating event network-vif-deleted:deb1beef-4279-4eb7-8f77-beec25a50790 for instance add96aba-6f75-4d91-b87a-8fe1918c02ab on hv-cinder-79123 May 24 10:15:17.357614 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-a01f507d-ad79-4dbf-877b-5b807c742c26 req-c4e2bc2f-7d0f-400a-81c9-9a6c9238b9bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071772 May 24 10:15:17.358785 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 539/1067] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:15:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:17.745140 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:17.746771 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:17.762199 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:17.763215 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:17.764870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:17.765872 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:18.077767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:18.088408 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f7b1f6fd-037b-4d87-9ca7-b856a073546f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 200 len: 1226 microversion: 2.1 time: 0.350448 May 24 10:15:18.089253 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 529/1068] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:17 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 1226 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:19.111167 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:19.112299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:19.121858 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:19.122323 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:19.123354 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:19.124429 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:19.182292 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] HTTP exception thrown: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. May 24 10:15:19.182918 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Returning 404 to user: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:15:19.183803 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-fddeb37b-bcde-4031-a06e-885d40eca98c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 404 len: 111 microversion: 2.1 time: 0.078678 May 24 10:15:19.184418 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 540/1069] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:19 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:15:19.253941 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573703874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1733835921", "security_groups": [{"name": "tempest-secgroup-smoke-525824861"}], "block_device_mapping_v2": [{"uuid": "18285a16-d01b-488b-b5e4-8ac528cd13c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3670d884-4bc4-4d4e-8dbb-1165ed224ea7"}]}} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:19.530843 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.network.neutron [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] validate_networks() for [('3670d884-4bc4-4d4e-8dbb-1165ed224ea7', None, None, None)] {{(pid=123673) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:15:20.234560 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:15:20.235188 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image limits 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:15:20.235855 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:15:20.236410 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image pref 0:0:0 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:15:20.237247 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.virt.hardware [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:15:20.255118 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:20.255978 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:20.257602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:20.258480 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:20.298691 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:15:20.307396 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.quota [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for user c4dbf97d94554a0c826ff1b17db17474 and project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123673) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:15:20.423285 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Going to run 1 instances... {{(pid=123673) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:15:20.425659 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18285a16-d01b-488b-b5e4-8ac528cd13c1',volume_size=None,volume_type=None)] {{(pid=123673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:15:20.913173 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-68d6c1af-3672-4785-a200-707987fff509 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.664730 May 24 10:15:20.913828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 530/1070] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:15:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:15:20.927998 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e2430ed0-011e-4b26-8946-42a21221ee5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:20.929223 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e2430ed0-011e-4b26-8946-42a21221ee5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:21.016129 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e2430ed0-011e-4b26-8946-42a21221ee5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:21.032554 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e2430ed0-011e-4b26-8946-42a21221ee5f tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1094 microversion: 2.1 time: 0.108028 May 24 10:15:21.033644 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 541/1071] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:20 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:22.063420 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:22.064098 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:22.072607 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:22.073175 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:22.073985 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:22.074438 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:22.231477 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:22.249596 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-944bb877-84fe-4048-be9b-c28c316de7c9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1144 microversion: 2.1 time: 0.189803 May 24 10:15:22.250709 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 531/1072] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:22 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1144 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:23.268276 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:23.268934 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:23.281883 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:23.282346 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:23.283217 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:23.283703 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:23.438329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:23.447784 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b458347b-4e20-4603-a039-d2089654b168 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1192 microversion: 2.1 time: 0.183619 May 24 10:15:23.448397 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 542/1073] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:23 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1192 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:24.466730 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:24.467997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:24.476437 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:24.477031 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:24.477871 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:24.478323 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:24.632264 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:24.648889 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-a28572e0-684b-4f05-b007-ef61bda1b993 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1210 microversion: 2.1 time: 0.185759 May 24 10:15:24.650018 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 532/1074] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:24 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:25.673079 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:25.676753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:25.690125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:25.690125 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:25.691672 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:25.692688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:26.040920 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:26.059595 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-e7217334-6467-449f-afcc-2a3373869af1 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.394363 May 24 10:15:26.061501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 543/1075] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:25 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:26.533104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-700b25be-2bf5-4dc9-956a-924bd0cf401a req-7181b464-e6b2-4d7a-9ba5-5b7f0bb2bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f59907d-df21-4f39-8704-0140f911e592", "tag": "2faafcb9-9d9d-4bf2-997a-509be060bb30"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:26.537886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:15:26.537886 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:15:26.563977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-700b25be-2bf5-4dc9-956a-924bd0cf401a req-7181b464-e6b2-4d7a-9ba5-5b7f0bb2bd2b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:26.563977 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-700b25be-2bf5-4dc9-956a-924bd0cf401a req-7181b464-e6b2-4d7a-9ba5-5b7f0bb2bd2b service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:26.597334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-700b25be-2bf5-4dc9-956a-924bd0cf401a req-7181b464-e6b2-4d7a-9ba5-5b7f0bb2bd2b service nova] Creating event network-changed:2faafcb9-9d9d-4bf2-997a-509be060bb30 for instance 6f59907d-df21-4f39-8704-0140f911e592 on hv-cinder-79123 May 24 10:15:26.607468 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-700b25be-2bf5-4dc9-956a-924bd0cf401a req-7181b464-e6b2-4d7a-9ba5-5b7f0bb2bd2b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082433 May 24 10:15:26.609849 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 533/1076] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:27.087395 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:27.088158 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:27.100335 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:27.101197 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:27.102751 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:27.103587 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:27.386020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:27.396568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-a70c075f-e643-45df-bad8-83cfb66cd6c7 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.312955 May 24 10:15:27.397194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 544/1077] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:27 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:28.415185 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:28.415804 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:28.424949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:28.425449 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:28.426251 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:28.426695 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:28.720802 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:28.730304 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-26b3eee0-ce98-444a-9f7a-1abd440b5561 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.319382 May 24 10:15:28.730900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 534/1078] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:28 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:29.747477 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:29.748103 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:29.756459 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:29.756959 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:29.760597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:29.760597 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:30.149476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:30.165146 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-fdd920ea-b12b-4f60-9bd8-7f7d81f046ef tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.421061 May 24 10:15:30.166203 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 545/1079] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:29 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:30.269755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:15:30.270081 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:15:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:15:31.191837 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:31.192562 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:31.200707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:31.201265 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:31.202685 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:31.203230 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:31.444217 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:31.453893 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-37e203d5-c5aa-480b-91de-cc5db2902c28 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.266033 May 24 10:15:31.454485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 535/1080] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:31 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:32.473810 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:32.474461 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:32.484773 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:32.485340 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:32.486609 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:32.487454 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:32.746266 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:32.756075 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ec4d9286-436e-4440-bc3c-49c7428eb79e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.285891 May 24 10:15:32.756798 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 546/1081] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:32 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:33.780299 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:33.781177 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:33.789563 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:33.790027 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:33.790836 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:33.791284 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:34.063763 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:34.079997 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-15035844-9489-4455-a8f1-1acd2ac6b70d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.303885 May 24 10:15:34.081064 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 536/1082] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:33 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:35.105680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:35.106866 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:35.121289 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:35.122086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:35.123988 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:35.124804 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:35.340182 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:35.349384 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f8b4bd12-3ad9-4791-9d05-52f48aef1d30 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.251007 May 24 10:15:35.349973 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 547/1083] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:35 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:36.369795 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:36.370487 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:36.378628 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:36.379087 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:36.380111 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:36.380545 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:36.789727 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:36.804481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-edfe6d0f-7c7d-42c5-87d3-389899656003 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.438529 May 24 10:15:36.805592 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 537/1084] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:36 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:37.822884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:37.823501 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:37.831515 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:37.831974 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:37.832772 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:37.833245 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:38.055039 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:38.072017 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-266f458e-0918-4849-a047-4e6345bb2bfc tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.252510 May 24 10:15:38.073219 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 548/1085] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:37 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:38.611926 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-3ac28d98-b838-46db-b14a-54caa1e42ec6 req-bbe01d1c-0b7a-42b7-914f-685fefbab1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f59907d-df21-4f39-8704-0140f911e592", "name": "network-vif-plugged", "status": "completed", "tag": "2faafcb9-9d9d-4bf2-997a-509be060bb30"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:38.614661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:15:38.614661 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:15:38.626644 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3ac28d98-b838-46db-b14a-54caa1e42ec6 req-bbe01d1c-0b7a-42b7-914f-685fefbab1f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:38.627313 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-3ac28d98-b838-46db-b14a-54caa1e42ec6 req-bbe01d1c-0b7a-42b7-914f-685fefbab1f8 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:38.647939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-3ac28d98-b838-46db-b14a-54caa1e42ec6 req-bbe01d1c-0b7a-42b7-914f-685fefbab1f8 service nova] Creating event network-vif-plugged:2faafcb9-9d9d-4bf2-997a-509be060bb30 for instance 6f59907d-df21-4f39-8704-0140f911e592 on hv-cinder-79123 May 24 10:15:38.653132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-3ac28d98-b838-46db-b14a-54caa1e42ec6 req-bbe01d1c-0b7a-42b7-914f-685fefbab1f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050141 May 24 10:15:38.653825 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 538/1086] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:39.093621 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:39.095730 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:39.110422 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:39.111240 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:39.112730 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:39.113599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:39.344481 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:39.353767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-de1bdc1d-7205-4573-9126-c950a5e2fa0e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1265 microversion: 2.1 time: 0.267063 May 24 10:15:39.354362 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 549/1087] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:39 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:40.371663 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:40.372443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:40.380648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:40.381133 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:40.381962 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:40.382404 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:40.603362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:40.613680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c64f0194-f3b8-4d0b-8928-9840b55927a0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1453 microversion: 2.1 time: 0.246296 May 24 10:15:40.614344 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 539/1088] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:40 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1453 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:40.635516 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:40.636583 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:15:40.650589 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:40.651426 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:40.652883 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:40.653753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:40.906352 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:40.915295 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b579abe4-1f5e-454b-931a-42fcd5c8c61d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1453 microversion: 2.1 time: 0.287237 May 24 10:15:40.915878 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 550/1089] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:15:40 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1453 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:44.175611 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-1465937a-5389-4f46-88ef-a8879d19cfa8 req-55412a9f-b34c-4160-82aa-be74351a2d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f59907d-df21-4f39-8704-0140f911e592", "tag": "2faafcb9-9d9d-4bf2-997a-509be060bb30"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:44.178963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:15:44.178963 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:15:44.195687 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-1465937a-5389-4f46-88ef-a8879d19cfa8 req-55412a9f-b34c-4160-82aa-be74351a2d0f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:15:44.196503 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-1465937a-5389-4f46-88ef-a8879d19cfa8 req-55412a9f-b34c-4160-82aa-be74351a2d0f service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:15:44.231642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-1465937a-5389-4f46-88ef-a8879d19cfa8 req-55412a9f-b34c-4160-82aa-be74351a2d0f service nova] Creating event network-changed:2faafcb9-9d9d-4bf2-997a-509be060bb30 for instance 6f59907d-df21-4f39-8704-0140f911e592 on hv-cinder-79123 May 24 10:15:44.241290 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-1465937a-5389-4f46-88ef-a8879d19cfa8 req-55412a9f-b34c-4160-82aa-be74351a2d0f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072551 May 24 10:15:44.242601 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 540/1090] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:15.173688 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-408891060", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1733835921", "security_groups": [{"name": "tempest-secgroup-smoke-525824861"}], "block_device_mapping_v2": [{"uuid": "9d4ae0dc-1fed-42b7-94e5-cb938f1cd6ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3670d884-4bc4-4d4e-8dbb-1165ed224ea7"}]}} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:15.347102 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.network.neutron [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] validate_networks() for [('3670d884-4bc4-4d4e-8dbb-1165ed224ea7', None, None, None)] {{(pid=123672) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 24 10:17:16.136396 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 24 10:17:16.136964 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image limits 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 24 10:17:16.137643 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Flavor pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 24 10:17:16.138142 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Image pref 0:0:0 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 24 10:17:16.138628 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.virt.hardware [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 24 10:17:16.148300 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:16.148755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:16.149641 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:16.150095 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:16.171166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 24 10:17:16.175892 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.quota [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Getting quotas for user c4dbf97d94554a0c826ff1b17db17474 and project 2cc9bd0e4be64b0e9add9a9f9e8bbe52. Resources: {'ram', 'instances', 'cores'} {{(pid=123672) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 24 10:17:16.283983 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Going to run 1 instances... {{(pid=123672) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 24 10:17:16.286539 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d4ae0dc-1fed-42b7-94e5-cb938f1cd6ee',volume_size=None,volume_type=None)] {{(pid=123672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 24 10:17:16.788768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-4f0192a9-bbfd-4dfc-9bf1-f087c3a6ffd4 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.618998 May 24 10:17:16.789356 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 551/1091] 10.222.0.67 () {60 vars in 1147 bytes} [Mon May 24 10:17:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:17:16.805511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 24 10:17:16.813929 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ab8708dc-dd58-4b13-9ad5-3003fd8ab840 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:16.816791 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ab8708dc-dd58-4b13-9ad5-3003fd8ab840 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:16.914937 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ab8708dc-dd58-4b13-9ad5-3003fd8ab840 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:16.934900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ab8708dc-dd58-4b13-9ad5-3003fd8ab840 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1094 microversion: 2.1 time: 0.134464 May 24 10:17:16.935968 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 541/1092] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:16 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1094 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:17.960034 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:17.960680 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:17.970980 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:17.971417 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:17.972221 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:17.972667 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:18.111329 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:18.121737 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-d7334368-70a1-4a5d-9774-ecad70987ab8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1144 microversion: 2.1 time: 0.165854 May 24 10:17:18.122606 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 552/1093] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:17 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1144 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:19.146901 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:19.148348 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:19.181939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:19.182964 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:19.184401 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:19.185113 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:19.305155 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] [4066af81-373a-4ffd-9b71-257cfc661c1a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38522. May 24 10:17:19.393519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:19.405727 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-5ee9d248-31ad-4cce-a11f-d4b26be882ae tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1200 microversion: 2.1 time: 0.268188 May 24 10:17:19.410168 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 542/1094] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:19 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1200 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:20.433802 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:20.435033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:20.448916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:20.449768 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:20.451277 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:20.452074 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:20.624194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:20.624194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-f21d11ec-e49a-4043-b9ef-232eb740d2ba tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1210 microversion: 2.1 time: 0.185648 May 24 10:17:20.624194 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 553/1095] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:20 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1210 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:20.742758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:17:20.743630 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:17:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:17:21.632223 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:21.632854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:21.640854 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:21.641362 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:21.642170 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:21.642616 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:22.198334 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:22.209144 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-75c4e868-453a-4e2a-bc8a-74d33e59894b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.580746 May 24 10:17:22.211940 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 543/1096] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:21 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:22.462529 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-f8067852-aadd-4040-91b5-e60e72694a06 req-6ce7b1ed-755c-41cb-baaa-e2ac1c204962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd96baf8-8c02-4183-a815-a72afc46f394", "tag": "f1ec19f0-7419-4db3-9689-1d76c1528de8"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:22.465443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:17:22.465443 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:17:22.478963 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f8067852-aadd-4040-91b5-e60e72694a06 req-6ce7b1ed-755c-41cb-baaa-e2ac1c204962 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:22.480068 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-f8067852-aadd-4040-91b5-e60e72694a06 req-6ce7b1ed-755c-41cb-baaa-e2ac1c204962 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:22.504099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-f8067852-aadd-4040-91b5-e60e72694a06 req-6ce7b1ed-755c-41cb-baaa-e2ac1c204962 service nova] Creating event network-changed:f1ec19f0-7419-4db3-9689-1d76c1528de8 for instance bd96baf8-8c02-4183-a815-a72afc46f394 on hv-cinder-79123 May 24 10:17:22.510057 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-f8067852-aadd-4040-91b5-e60e72694a06 req-6ce7b1ed-755c-41cb-baaa-e2ac1c204962 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130698 May 24 10:17:22.511166 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 554/1097] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:23.228439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:23.229481 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:23.239984 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:23.240602 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:23.241975 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:23.243974 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:23.688231 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:23.697906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-f0ecbd52-8089-49cb-a218-77a00b9f5b46 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.473725 May 24 10:17:23.699240 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 544/1098] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:23 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:24.716622 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:24.717613 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:24.726218 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:24.726678 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:24.727478 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:24.727916 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:24.953008 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:24.962161 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-00c42754-a883-4e3d-acbe-cc329f794f8b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.250049 May 24 10:17:24.962755 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 555/1099] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:24 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:25.982506 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:25.983136 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:25.991181 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:25.991686 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:25.992501 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:25.992958 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:26.210145 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:26.225120 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-ac3a67b9-d498-43cf-9380-a005190762d2 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.246070 May 24 10:17:26.225758 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 545/1100] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:25 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:27.252426 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:27.253115 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:27.262590 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:27.263106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:27.264112 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:27.264612 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:27.533547 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:27.545041 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c7fbce21-0470-4ad6-a2ca-5ff09697a48e tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.296735 May 24 10:17:27.545738 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 556/1101] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:27 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:28.563735 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:28.564419 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:28.573281 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:28.573825 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:28.574603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:28.575053 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:28.799621 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:28.808947 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-45d13cbf-bef3-4259-81be-03cc18bc85b0 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.249324 May 24 10:17:28.809581 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 546/1102] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:28 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:29.878978 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:29.880013 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:29.888274 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:29.888728 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:29.889581 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:29.890025 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:30.103629 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:30.112972 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-6f7dfb48-fa46-40ef-913f-4f755217584a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.288833 May 24 10:17:30.113601 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 557/1103] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:29 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:31.130413 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:31.131107 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:31.139849 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:31.140295 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:31.141307 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:31.141750 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:31.394541 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:31.394541 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-4ae46648-8d91-418c-962f-a64e193a3984 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.266343 May 24 10:17:31.394541 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 547/1104] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:31 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:32.415248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:32.416449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:32.430381 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:32.431449 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:32.433608 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:32.434423 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:32.698857 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:32.707751 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-2ad08701-02b2-4103-8147-f62a2f00034a tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.299564 May 24 10:17:32.708347 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 558/1105] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:32 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:33.080340 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-7fd34ba1-7231-4fdc-9415-ed54fb7f934f req-2658c90d-dd79-4f2d-a6be-289a1986cb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd96baf8-8c02-4183-a815-a72afc46f394", "name": "network-vif-plugged", "status": "completed", "tag": "f1ec19f0-7419-4db3-9689-1d76c1528de8"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:33.082648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:17:33.082648 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:17:33.092953 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-7fd34ba1-7231-4fdc-9415-ed54fb7f934f req-2658c90d-dd79-4f2d-a6be-289a1986cb43 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:33.093439 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-7fd34ba1-7231-4fdc-9415-ed54fb7f934f req-2658c90d-dd79-4f2d-a6be-289a1986cb43 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:33.111456 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-7fd34ba1-7231-4fdc-9415-ed54fb7f934f req-2658c90d-dd79-4f2d-a6be-289a1986cb43 service nova] Creating event network-vif-plugged:f1ec19f0-7419-4db3-9689-1d76c1528de8 for instance bd96baf8-8c02-4183-a815-a72afc46f394 on hv-cinder-79123 May 24 10:17:33.117511 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-7fd34ba1-7231-4fdc-9415-ed54fb7f934f req-2658c90d-dd79-4f2d-a6be-289a1986cb43 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042083 May 24 10:17:33.118303 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 548/1106] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:17:33.726314 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:33.726947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:33.735392 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:33.735856 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:33.736668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:33.737151 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:33.977128 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:33.988043 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-7cbbd5aa-37a7-4c2e-8f8f-0b5c012a8111 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1265 microversion: 2.1 time: 0.265394 May 24 10:17:33.988668 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 559/1107] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:33 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:34.288485 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:17:34.289357 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:17:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:17:35.011132 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:35.012011 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:35.020457 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:35.020903 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:35.021733 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:35.022169 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:35.254161 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:35.263734 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0f0a128d-91ba-4cab-ab7d-67663e4f8c6c tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1452 microversion: 2.1 time: 0.257602 May 24 10:17:35.264333 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 549/1108] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:35 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1452 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:35.281192 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:35.281829 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:17:35.289888 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:35.290402 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:35.291237 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:35.292224 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:35.611685 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:35.622898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-b90dd146-b6ce-464c-8256-763175260183 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1452 microversion: 2.1 time: 0.346094 May 24 10:17:35.623713 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 560/1109] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:17:35 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1452 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:38.969897 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-4c2619ac-57f1-4687-a0ed-a8d178e7df84 req-8f6ec471-857a-44a5-8f4e-1c30deea8b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd96baf8-8c02-4183-a815-a72afc46f394", "tag": "f1ec19f0-7419-4db3-9689-1d76c1528de8"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:38.972072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:17:38.972072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:17:38.982124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-4c2619ac-57f1-4687-a0ed-a8d178e7df84 req-8f6ec471-857a-44a5-8f4e-1c30deea8b37 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:17:38.982680 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-4c2619ac-57f1-4687-a0ed-a8d178e7df84 req-8f6ec471-857a-44a5-8f4e-1c30deea8b37 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:17:39.002920 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-4c2619ac-57f1-4687-a0ed-a8d178e7df84 req-8f6ec471-857a-44a5-8f4e-1c30deea8b37 service nova] Creating event network-changed:f1ec19f0-7419-4db3-9689-1d76c1528de8 for instance bd96baf8-8c02-4183-a815-a72afc46f394 on hv-cinder-79123 May 24 10:17:39.008827 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-4c2619ac-57f1-4687-a0ed-a8d178e7df84 req-8f6ec471-857a-44a5-8f4e-1c30deea8b37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141785 May 24 10:17:39.010734 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 550/1110] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:13.203456 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:18:13.204061 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:18:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:19:13.719085 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-576367ba-7e43-41c5-810a-4ee191118670 req-e720a872-300d-4cb7-8be3-c0e40143cb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd96baf8-8c02-4183-a815-a72afc46f394", "tag": "f1ec19f0-7419-4db3-9689-1d76c1528de8"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:13.720069 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:13.721020 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:13.725148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:19:13.725148 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:19:13.725771 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2026cb6-a8a3-46b7-8221-bfe52c9a18e3] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 10:19:13.733144 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:13.733884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:13.735617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:13.735617 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:13.743431 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-576367ba-7e43-41c5-810a-4ee191118670 req-e720a872-300d-4cb7-8be3-c0e40143cb6c service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:13.744200 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-576367ba-7e43-41c5-810a-4ee191118670 req-e720a872-300d-4cb7-8be3-c0e40143cb6c service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:13.779707 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-576367ba-7e43-41c5-810a-4ee191118670 req-e720a872-300d-4cb7-8be3-c0e40143cb6c service nova] Creating event network-changed:f1ec19f0-7419-4db3-9689-1d76c1528de8 for instance bd96baf8-8c02-4183-a815-a72afc46f394 on hv-cinder-79123 May 24 10:19:13.789088 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-576367ba-7e43-41c5-810a-4ee191118670 req-e720a872-300d-4cb7-8be3-c0e40143cb6c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074480 May 24 10:19:13.790257 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 551/1111] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:13.814359 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Going to try to terminate instance {{(pid=123672) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:19:14.218486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-47619994-bb5e-4700-82a9-abc56eddadc6 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 204 len: 0 microversion: 2.1 time: 0.508771 May 24 10:19:14.218486 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 561/1112] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:19:13 2021] DELETE /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:19:14.232061 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:14.233186 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:14.245276 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:14.246020 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:14.247079 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:14.247870 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:14.690024 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:14.707689 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-9abfb1f0-35da-4f72-9a15-d0af9053f064 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1577 microversion: 2.1 time: 0.483382 May 24 10:19:14.709124 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 552/1113] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:14 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1577 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:15.735186 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:15.736152 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:15.756753 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:15.757248 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:15.758140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:15.758599 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:15.815280 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2026cb6-a8a3-46b7-8221-bfe52c9a18e3] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38612. May 24 10:19:16.129393 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:16.141838 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-ba721e23-9926-49e9-9562-69c7c282718d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1458 microversion: 2.1 time: 0.410431 May 24 10:19:16.142646 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 562/1114] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:15 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1458 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:16.865633 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [req-2dc00191-2402-41f7-9590-df1590eb5dd5 req-0868fda6-fba3-45b3-952f-3aebdd4f4d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd96baf8-8c02-4183-a815-a72afc46f394", "name": "network-vif-deleted", "tag": "f1ec19f0-7419-4db3-9689-1d76c1528de8"}]} {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:16.868470 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:19:16.868470 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: warnings.warn(msg) May 24 10:19:16.877949 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2dc00191-2402-41f7-9590-df1590eb5dd5 req-0868fda6-fba3-45b3-952f-3aebdd4f4d16 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:16.878409 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [req-2dc00191-2402-41f7-9590-df1590eb5dd5 req-0868fda6-fba3-45b3-952f-3aebdd4f4d16 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:16.897783 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.compute.server_external_events [req-2dc00191-2402-41f7-9590-df1590eb5dd5 req-0868fda6-fba3-45b3-952f-3aebdd4f4d16 service nova] Creating event network-vif-deleted:f1ec19f0-7419-4db3-9689-1d76c1528de8 for instance bd96baf8-8c02-4183-a815-a72afc46f394 on hv-cinder-79123 May 24 10:19:16.903802 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [req-2dc00191-2402-41f7-9590-df1590eb5dd5 req-0868fda6-fba3-45b3-952f-3aebdd4f4d16 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042809 May 24 10:19:16.904494 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 553/1115] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:17.169864 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:17.171106 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:17.183005 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:17.183469 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:17.184297 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:17.184905 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:17.309268 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:17.318818 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-c56a3c9d-6162-4dbd-a86a-71bf664c45e9 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1225 microversion: 2.1 time: 0.156286 May 24 10:19:17.319428 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 563/1116] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:17 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:18.341430 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:18.345643 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:18.359847 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:18.360743 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:18.362068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:18.363064 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:18.447478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:18.447478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:18.447478 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.objects.instance [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lazy-loading 'fault' on Instance uuid bd96baf8-8c02-4183-a815-a72afc46f394 {{(pid=123673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 24 10:19:18.624620 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:18.633942 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-c33d9758-81c1-4dbf-b711-013fc34fc364 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 200 len: 1184 microversion: 2.1 time: 0.298847 May 24 10:19:18.634536 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 554/1117] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:18 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 1184 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:19.652070 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:19.652706 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: bd96baf8-8c02-4183-a815-a72afc46f394] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:19.660862 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:19.661472 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:19.662351 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:19.662847 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:19.738032 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] HTTP exception thrown: Instance bd96baf8-8c02-4183-a815-a72afc46f394 could not be found. May 24 10:19:19.738653 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Returning 404 to user: Instance bd96baf8-8c02-4183-a815-a72afc46f394 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:19:19.739510 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-767c36d7-9b9b-4bed-a9ab-73bc14b28b43 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394" status: 404 len: 111 microversion: 2.1 time: 0.092089 May 24 10:19:19.740108 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 564/1118] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:19 2021] GET /compute/v2.1/servers/bd96baf8-8c02-4183-a815-a72afc46f394 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:24.416923 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:24.417840 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:24.421640 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-062966a5-f6b8-46d2-ac0d-8950f69a0db7 req-7d4227e9-ef53-4325-9db8-481131862cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f59907d-df21-4f39-8704-0140f911e592", "tag": "2faafcb9-9d9d-4bf2-997a-509be060bb30"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:24.423947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:19:24.423947 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:19:24.427065 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:24.427533 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:24.428352 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:24.429624 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:24.435884 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-062966a5-f6b8-46d2-ac0d-8950f69a0db7 req-7d4227e9-ef53-4325-9db8-481131862cac service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:24.436790 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-062966a5-f6b8-46d2-ac0d-8950f69a0db7 req-7d4227e9-ef53-4325-9db8-481131862cac service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:24.455604 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-062966a5-f6b8-46d2-ac0d-8950f69a0db7 req-7d4227e9-ef53-4325-9db8-481131862cac service nova] Creating event network-changed:2faafcb9-9d9d-4bf2-997a-509be060bb30 for instance 6f59907d-df21-4f39-8704-0140f911e592 on hv-cinder-79123 May 24 10:19:24.462382 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-062966a5-f6b8-46d2-ac0d-8950f69a0db7 req-7d4227e9-ef53-4325-9db8-481131862cac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045551 May 24 10:19:24.463416 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 565/1119] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:19:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:24.497767 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Going to try to terminate instance {{(pid=123673) delete /opt/stack/nova/nova/compute/api.py:2539}} May 24 10:19:24.870604 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-0f26dea0-1814-42eb-8e46-bd1e916c2630 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 204 len: 0 microversion: 2.1 time: 0.456262 May 24 10:19:24.871705 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 555/1120] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:19:24 2021] DELETE /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:19:24.885249 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:24.886145 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:24.895264 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:24.896568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:24.898686 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:24.899246 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:25.160489 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.policy [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123672) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:25.174476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-9ec69647-fb0c-4bb9-a1bc-2835083e353d tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1578 microversion: 2.1 time: 0.297513 May 24 10:19:25.175568 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 566/1121] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:24 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:26.193588 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:26.194351 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:26.202482 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:26.202939 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:26.203745 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:26.204186 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:26.779603 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:26.790072 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-27d4e953-2b88-4b60-9055-1d88fc64f401 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1459 microversion: 2.1 time: 0.600499 May 24 10:19:26.790606 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 556/1122] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:26 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1459 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:27.484279 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [req-d8d41b0d-ffd6-47c4-b78a-a0107f703bae req-92da521d-2617-4cec-86ea-23e40ead8ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f59907d-df21-4f39-8704-0140f911e592", "name": "network-vif-deleted", "tag": "2faafcb9-9d9d-4bf2-997a-509be060bb30"}]} {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:27.486448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:19:27.486448 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: warnings.warn(msg) May 24 10:19:27.496582 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d8d41b0d-ffd6-47c4-b78a-a0107f703bae req-92da521d-2617-4cec-86ea-23e40ead8ff7 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:27.500476 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [req-d8d41b0d-ffd6-47c4-b78a-a0107f703bae req-92da521d-2617-4cec-86ea-23e40ead8ff7 service nova] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:27.515394 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.compute.server_external_events [req-d8d41b0d-ffd6-47c4-b78a-a0107f703bae req-92da521d-2617-4cec-86ea-23e40ead8ff7 service nova] Creating event network-vif-deleted:2faafcb9-9d9d-4bf2-997a-509be060bb30 for instance 6f59907d-df21-4f39-8704-0140f911e592 on hv-cinder-79123 May 24 10:19:27.520731 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [req-d8d41b0d-ffd6-47c4-b78a-a0107f703bae req-92da521d-2617-4cec-86ea-23e40ead8ff7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040787 May 24 10:19:27.521402 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 567/1123] 10.222.0.67 () {64 vars in 1318 bytes} [Mon May 24 10:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:27.812322 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:27.813828 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:27.829010 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:27.829901 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:27.831443 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:27.832245 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:28.122163 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.policy [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dbf97d94554a0c826ff1b17db17474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9bd0e4be64b0e9add9a9f9e8bbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123673) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:28.132068 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-d2a9cf43-0c72-4dd4-8cd8-190712a91a9b tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 200 len: 1225 microversion: 2.1 time: 0.327123 May 24 10:19:28.132906 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 557/1124] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:27 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 1225 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:29.150089 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:29.151086 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: 6f59907d-df21-4f39-8704-0140f911e592] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:29.159538 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:29.160898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:29.160898 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:29.161316 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:29.215059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] HTTP exception thrown: Instance 6f59907d-df21-4f39-8704-0140f911e592 could not be found. May 24 10:19:29.215677 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Returning 404 to user: Instance 6f59907d-df21-4f39-8704-0140f911e592 could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:19:29.216537 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-3bd51dac-acc3-4d82-a71f-dc728d155a03 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592" status: 404 len: 111 microversion: 2.1 time: 0.070968 May 24 10:19:29.217140 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 568/1125] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:29 2021] GET /compute/v2.1/servers/6f59907d-df21-4f39-8704-0140f911e592 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:30.185873 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:30.186468 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.compute.api [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123673) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:30.195104 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:30.195518 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:30.198017 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:30.198532 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG oslo_concurrency.lockutils [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:30.251672 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.wsgi [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] HTTP exception thrown: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. May 24 10:19:30.252277 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Returning 404 to user: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. {{(pid=123673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:19:30.253149 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-393176df-f0f9-4714-a0a5-43a42c42fa90 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "DELETE /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 404 len: 111 microversion: 2.1 time: 0.072879 May 24 10:19:30.253717 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 558/1126] 10.222.0.67 () {58 vars in 1239 bytes} [Mon May 24 10:19:30 2021] DELETE /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:30.264767 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '>' {{(pid=123672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:30.265446 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.compute.api [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] [instance: add96aba-6f75-4d91-b87a-8fe1918c02ab] Fetching instance by UUID {{(pid=123672) get /opt/stack/nova/nova/compute/api.py:2790}} May 24 10:19:30.273299 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:30.273818 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:30.274647 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 24 10:19:30.275099 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG oslo_concurrency.lockutils [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Lock "0577e5e4-7500-4c18-a8f3-3e205040b20a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 24 10:19:30.330198 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.wsgi [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] HTTP exception thrown: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. May 24 10:19:30.330820 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: DEBUG nova.api.openstack.wsgi [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Returning 404 to user: Instance add96aba-6f75-4d91-b87a-8fe1918c02ab could not be found. {{(pid=123672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 24 10:19:30.331673 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO nova.api.openstack.requestlog [None req-efe0d353-39a3-45c9-b575-fdd996fcdae8 tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab" status: 404 len: 111 microversion: 2.1 time: 0.070801 May 24 10:19:30.332238 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: [pid: 123672|app: 0|req: 569/1127] 10.222.0.67 () {58 vars in 1236 bytes} [Mon May 24 10:19:30 2021] GET /compute/v2.1/servers/add96aba-6f75-4d91-b87a-8fe1918c02ab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:19:32.189292 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: DEBUG nova.api.openstack.wsgi [None req-e62da3e6-479a-4dc0-a5f0-d1046f2350ca tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] Calling method '.version_select at 0x7f0a385c0a60>' {{(pid=123673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:32.274519 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO nova.api.openstack.requestlog [None req-e62da3e6-479a-4dc0-a5f0-d1046f2350ca tempest-TestVolumeBootPattern-2018797883 tempest-TestVolumeBootPattern-2018797883-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1733835921" status: 202 len: 0 microversion: 2.1 time: 0.089005 May 24 10:19:32.275370 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: [pid: 123673|app: 0|req: 559/1128] 10.222.0.67 () {58 vars in 1263 bytes} [Mon May 24 10:19:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1733835921 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:20:30.292077 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:20:30.292789 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:20:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:20:54.317900 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:20:54.318561 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:20:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:21:33.223033 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:21:33.223890 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:21:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:22:20.778683 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:22:20.779572 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:22:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:22:27.553399 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:22:27.554059 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:22:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:22:41.427289 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:22:41.428150 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:22:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:23:50.311322 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:23:50.311986 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:23:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:24:14.340788 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:24:14.341642 dv-cinder-791239-2-iscsi devstack@n-api.service[123673]: Mon May 24 10:24:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:24:53.242154 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:24:53.242824 dv-cinder-791239-2-iscsi devstack@n-api.service[123672]: Mon May 24 10:24:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!